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(57)[ABSTRACT OF THE DISCLOSURE] 



[SUBJECT OF THE INVENTION] 

It can grasp the perimeter situation of vehicles 
exactly. 



**JHB3 6 0° 



[PROBLEM TO BE SOLVED] 

It has the optical system 4a which reflects the 
light irradiated from the visual-field region of 
maximum perimeter 360 degrees to the 
prescribed direction, and the image pick-up part 
4b which photographs the reflection light which 
reflects by the optical system 4a and acquires 
omnidirectional image data, and is equipped 
with the omnidirectional camera 4 provided in 
the side part of vehicles, the image data 
converter 6 which converts into the image data 
of a predetermined display type the 
omnidirectional image data photographed by 
the omnidirectional camera 4, and the display 
section 9 which is provided near the driver of 
vehicles and displays the conversion image 
data converted by the image data converter 6. 
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1 : Control part 

2: Program memory 

3: Buffer memory 

4: Omnidirectional camera 

4a: Optical system 

4b: Image pick-up part 

5: Mirror apparatus 

5a: Fender mirror/side-mirror 

5b: Housing 

5c: Attachment 

5d: Retainer 

6: Image data converter 

7: Conversion information storage part 

8: Image data storage part 

9: Display part 

10: Display control part 

11: Display range specification part 

12: Operation detection part 

13: Operation information generation part 
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14: Moving-body detection part 

15: Moving-body speed measurement part 

16: Alarm-output part 

17: Communication part 



[CLAIMS] 



[W?#rfU] 

m±mm3 6 o° ommmm 



[CLAIM 1] 

It has the optical system which reflects the light 
irradiated from the visual-field region of 
maximum perimeter 360 degrees to the 
prescribed direction, and the image pick-up part 
which photographs the reflection light which 
reflects by said optical system and acquires 
omnidirectional image data, and is equipped 
with the omnidirectional camera provided in the 
side part of vehicles, the image data converter 
which converts into the image data of a 
predetermined display type the omnidirectional 
image data photographed by said 
omnidirectional camera, and the display section 
which is provided near the driver of vehicles and 
displays the conversion image data converted 
by said image data converter. 
The vehicle perimeter display device 
characterized by the above-mentioned. 



[tmm 2 ] [CLAIM 2] 

tijf£^^fi^7 / 7 (i, MffiP) A vehicle perimeter display device of Claim 1 in 

&fc(D&iMp$l(Z : £i%- : {:ii*krt b which said omnidirectional camera is provided 

tiTV^ W^ 3 ! 1 ^fSfcW^ in each right and left part of vehicle. 



[ff3fcif3] [CLAIM 3] 

mtHikjjitLft ^ 7 (i, $pjco A vehicle perimeter display device of Claim 1 or 
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&%<D&MlR\z%ti^tiffltftb 2 in which said omnidirectional camera is 

tl%x7 Hgg<Z?5te^pH5K:Bx 9 attached to the tip of the each mirror apparatus 

tttt bfrlXh^Z), tn$Z*Kll£tc provided in each right and left side part of 

tt 2 \zmm<DMmmm$t^ vehicles. 



[ff*Jl4] [CLAIM 4] 

mJfS^^fi^ / 7 lt s A vehicle perimeter display device in any one of 

M1$\c&\s^XW^JfcRtfty^Jft Claim 1-3 in which said omnidirectional camera 

<Dfci%\z^fo^timrtbtiZ>y- is attached to the tip of the each side-mirror 

4 K$ 7 — ^5feffip|5^^ti^ti provided near a driver's seat and the front 

*9 # b friX If 1 passenger seat in both sides of vehicle. 
- 3 ^7)V^Tt^A^c:fe«^^7)^p]^ 



[ff*i!5] [CLAIMS] 

^7lt ^fSfifJ A vehicle perimeter display device in any one of 

$$o~)7 ^ tdlxtt hfriZ> 7 Claim 1-3 in which said omnidirectional camera 

^yy— 5 7— <755feSp|5^^:ti is attached to the tip of the each fender mirror 

^ft^tttt bftT^5, ft* provided in the fender of a side part of vehicle. 
31 1 - 3 ©v^ft^fclBic©*: 



[ft*« 6] [CLAIM 6] 

ttlffl^^i^ ^ 7 fi^ pffl 5 A vehicle perimeter display device in any one of 

^^-^S^rtpPt^^l^iZi^tiT Claim 1-5 in which said omnidirectional camera 

-5 , IS* 3 ! 1 ~ 5 co 1/ ^fh^ is built into the inside of said mirror apparatus. 

^IB«©WiilS^^So 



[fi*Jf 7] [CLAIM 7] 

iuf2^:^"{i^7 ^ 7 (D%^^ The vehicle perimeter display device in any one 

&^®tK£/cfiMffi^^ of Claim 1-6 in which The optical system of said 

(DfiMlHllsffc^ 7 — MJ: oT1# omnidirectional camera comprises the convex 

fi££tiTi/ N <5^ It* 1 ! 1 ~ 6 type rotary-body mirror of parabolic sheet-like or 

v^i* tt^lclEtt©* ^ffl*^ hyperbolic sheet-like etc. 
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[»jfcJS8l [CLAIM 8] 

RiffBH^T^- 9 fSiftpflli, m A vehicle perimeter display device in any one of 

fS^^fiE^^ 7lu«kotfift$ Claim 1-7 in which said image data converter 

titc&jjiiLWli&'T converts into panorama image data or the 

7-?W0i&'r — $ ^tzit^M^W^ perspection image data the omnidirectional 

x — * 2k ft^^Sl^ image data photographed by said 

7 <z>^1* tt^M^feftW^jSJj^H omnidirectional camera. 



[MM 9 ] [CLAIM 9] 

btitcs^> K/K The operation detection part which detects the 

^"InlJt^SS^wKjf^Sr^l^ni" 2) operation of vehicles by detecting action of a 

^ t (dct 9 MWi^W^&Wti^&tik handle, a turn signal, etc. provided in vehicles, 

&1"5S$5tSffM&&pffi <t > the operation information generation part which 

v£Mfefflitf?&%nlRfc £ 2>1fe%a1fe forms operation information including the run 

^dS^VT, MWidfeffJjfil direction of vehicles based on the detection 

£^tfi!lEff^££A£-t"5&fe result by this operation detection part, the 

ff$i£j$;gp <t N display control part which controls the image 

h&IE^^pR^S^^^SH^S: displayed on said display section based on the 

tufSil$Slf $B£$Cpfl(-cfcoT£ operation information formed by said operation 

fi5c^tiSil(Stf^^S^V^'C^j information generation part, the vehicle 

P1~S^^r|iiJ$Pp|5 1 , perimeter display device in any one of Claim 1-8 

£: £ &mix."CV N 5* ft 1 further equipped with these. 

0] [CLAIM 10] 

^IB^TFpRf^fi^ ffiffiWtx The vehicle perimeter display device in any one 

— $W^$ftW^\^tz^^M$L of Claim 1-9 with which the multiple-purpose 

^ itS&i&IHSr cfTt? information which contains a road map in said 

#@#jff $&^®So±U:^7F:£ti display section with the conversion image data 

5. It^ 3 ! 1 ~ 9 which said image data converter converted is 

ti^co^WiMW^^^Mo displayed on a screen. 

ummi i] [claim 11] 
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mfffi^^^f|5(7)HS±(«i^?r: £ It has further the display range specification part 

H/cpfS^t^pij^^^oi/^T^fM which designates the desired display range in 

W^^$GlS^rfi^'t''5^^t5ffl said conversion image displayed on the screen 

fBA^ptf^r £ ;i> of said display section, the vehicle perimeter 

mjffi^^p|5^®®±f-H^ display device in any one of Claim 1-10 which 

^tallti JfefcBfc £ *9 fa^^ti/c the image data of the display range designated 

^^^fflcojij^x — Zifi^LiK^: by this display range specification part is 

tiX^Tjk^ tl<5 > ft 1^-1 enlarged, and is displayed on the screen of said 

0(DV^Tti7i^-teic^^I^iiia display section. 

[IIMl 2] [CLAIM 12] 

mjf£^^*fi^? ^ 7 (^<fc 9 #|{& Image data storage part which carries out 

£H7t£;^4i®^x — ^ £r 7 renewal of the omnidirectional image data 

— ^ ^{\L T?I(fi#; JE^f bTffilei" photographed with said omnidirectional camera 

5®{^x~^f2fS£fl £ > of sequential per frame, and stores it, it carries 

f^Mf^x — ^ffilf^^^ 7 A out the pattern matching of each 

W£~Ct@HU^ LfcfL^rfSia^ix omnidirectional image data which got mixed up 

fcM^Ilif-^^^^^ per frame and by which the updating memory 

$PJMScifi was carried out to this image data storage part, 

1~£^lJjf££1^&1~5#l^{$^ the moving-body detection part which detects 

the moving body close to vehicles, the 

^jSjdlgtt htltcMWM&fi'i: moving-body speed measurement part which 

#1LT, f^®J^^^0pP(^ct measures the speed which the moving body 

^X&&£fritz&W)i$fc&W}~f detected by this moving-body detection part 

&&!£&M1£^ : b&W}{$$LBtffl transfers with reference to the vehicles 

t s speedometer provided in vehicles, the 

i^ibfl^iiSS'J^pP^TSy^^ alarm-output part which outputs an alarm or 

titc&W)i$<Di&if$Lfc* WfeiMUL alarm information when the speed of the 

±<Di§S"C$i^](^^i£cLTV^7t moving body measured in this moving-body 
4§-nM* fJr$R£fcf±lf$B1f speed measurement part is approaching 

tt}^J^S^$Btti^pP<!r , vehicles the speed more than a prescribed 

value, 

£r £ h tc{§ x. X V > <5 , If^il 1 The vehicle perimeter display device in any one 

~ 1 1 <D\t^ m ?tiMz.fS5 l 1fc<DMWi of Claim 1-11 further equipped with these. 
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[»#3gl 3] [CLAIM 13] 

^ftffife£titz#\*%$(D$&3ii^ It has further the communication part which 

ilff LT#Mtf makes communication connection with the 

if SiiiH pP£ $ ?5 (ci^i^, terminal unit of the exterior designated 

ftfjfe^lft^M^ beforehand, and transmits a variety of 

jftfM" 5 <t 9 (Cix information, said moving-body detection part is 

ft&tiXto*) s set up so that it may operate also after the 

&&W}fc&&1$fcM{fii<DT!i%l\z. shutdown of vehicles, when this moving-body 

Bff^B#r^W-h(-^/coT^ifiL detection part detects the moving body which 

tz&W){$&&&lstcW>ii^, hu approached near vehicles beyond over 

IBI^ffi^^/O^l^lf ffitat) predetermined time, while a warning sound is 

£tl<5 b&\^, Mffiiiff «t outputted from said alarm-output part, the alarm 

oT, ^ftl Ltz&W}f$<DW\&'r information which contains the image data of 

~? &^&WWL\nWmtZ%&3i the detected moving body by said 

^{ItcilHf mfffii®{^T f ~ communication part is transmitted to said 

^lEiftSPfi, f^^^ittcjiif terminal unit, said image data storage part is a 

LfcMftT — ^S:IEtSi"5. If vehicle perimeter display device of Claim 12 

1 2 (cfafic^^i^J^IS^^ which stores the image data which transmitted 

S*g 0 to this terminal unit. 

Itmmi 4] [CLAIM 14] 

§^:I^H3 6 0° (DlSfrM&ti&L It provides the omnidirectional camera which 

frhAftt£ti6yt$:$\fe3jfi\\z. has the image pick-up part which photographs 

K#t1"5ft^£K3t^"CS the reflection light which reflects the light 

tt1~ 5Jx#t)££rfiH£ UT^^ii irradiated from the visual-field region of 

if ftr^ £W#1~5ffiHtpft£: maximum 360 degrees by the optical system 

$rWi"S^^fiL*p < which reflects in the prescribed direction, and 

<D{M^\z.WLtf \ this optical system, and acquires 

%%£Jj{iLlJ * y^^^XMi^^ omnidirectional image data in the side part of 

fotcMWitDM^RXf'Tpft&lstf vehicles, it converts into the conversion image 

^^ilHfex — 9 £rffl^t\ data of a predetermined display type using the 

fiWLfe£titz^^]&M<D$£$M omnidirectional image data containing the side 

\z.W$k L> part and the lower part of vehicles which were 

W^WfeM l fa s r — $'&^ MWioyM photographed using this omnidirectional 
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^#WjJr{g{c:Hxft tbtitcMTFvb camera, it displays this conversion image data 
t &W0.t~tZ>M on the display section in which it was provided 
itfJji&o near the driver of vehicles. 

The perimeter display method of vehicles 
characterized by the above-mentioned. 



[ff*Jll5] [CLAIM 15] 

fS^ 1 ! 1 4 (-ISfcCO^jSjJilBI The perimeter display program of vehicles for 

0:7Fjjfe$:M?T~tZ)tc.&>(Di$.\i 5 i performing the perimeter display method of 

c/T7 , o^7A 0 vehicles of Claim 14. 



[DETAILED DESCRIPTION OF THE 
INVENTION] 



[0 0 0 1 ] 



[0001] 



7 — ^ ( i 7 ^ yy— x y—\z. 
tllt'bM c c D * ^ 7 

a £• izmm t ^ ^ o xmm -t % 



[TECHNICAL FIELD OF THE INVENTION] 

This invention relates to a vehicle perimeter 
display device. 

Specifically, it is related with the vehicle 
perimeter display device which can reach far 
and wide and can grasp the perimeter situation 
of vehicles by the video_information acquired 
by photographing means, such as a small CCD 
camera which was built into the both sides of 
vehicles, such as an automobile, by the 
side-mirror or the fender mirror in addition to the 
visual information obtained by carrying out the 
direct-vision private seal of the side-mirror or 
fender mirror each provided. 



[0 0 0 2] 



[0002] 



m*<D&m] [PRIOR ART] 

ggj^^oo^isncili, -irCD^iSj In order that the driver who operates the 
%'M$a-f 6jl$G#;6 5 ¥i5]CQpHRiJ vehicles may grasp the situation of the both 
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sides of vehicles on vehicles, such as an 
automobile, a side-mirror is each provided in 
the side part of right and left of vehicles, 
moreover, in order to grasp the situation of the 
rear of vehicles, a room mirror is provided in the 
center section of vehicle-inside. 



[0 0 0 3] 

IH 1 r<DJ; K5 



[0003] 

FIG. 11 is the top view each showing the 
horizontal blind-spot region which constitutes 
blind spot of the horizontal visual-field region 
which the driver who rides on the driver's seat of 
vehicles can recognize, and vehicles, and 
cannot be recognized by having such a 
side-mirror and a room mirror. 



[0 0 0 4] 

m 1 1 1^1" J: o (-> Mffitofti 



[0004] 

The forward-vision field region A obtained by as 
shown in FIG. 11 the driver who rides on 
vehicles ahead of vehicles viewing directly is 
formed with the prescribed viewing angle. 
Moreover, the lateral-view field region B 
obtained by the side-mirror with which 
each-side part of right and left of vehicles was 
each equipped is each formed in the method of 
each side of right and left of vehicles with the 
prescribed viewing angle. 
Furthermore, behind vehicles, the back 
visual-field region C obtained by the room mirror 
with which the front-side center section of 
vehicle-inside is equipped is formed with the 
prescribed viewing angle. 
To these visual-field region A-C, after the driver 
has been ahead suitable between the 
forward-vision field region A and the right and 



8/3/2006 



12/72 Copyright (C) 2006 The Thomson Corporation. 



JP2003-125396-A 



XHOIVISOIM 



«E#*Pi©;££$r«>lffl;frl£;b 



left lateral-view field region B, the side 
blind-spot region D which does not go into the 
visual-field region and does not go into the 
visual-field region of a side-mirror is formed. 
Moreover, the ahead side blind-spot region E 
which it produces when a side-mirror 
constitutes an obstruction in the forward-vision 
field region A is each formed over the 
right-and-left slanting ahead one of vehicles. 
Furthermore, between the right and left method 
visual-field region B of each side, and the back 
visual-field region C, the back blind-spot region 
F in which it is not reflected any of a right and 
left side-mirror and a right and left room mirror is 
each formed. 



[0 0 0 5] [0005] 

El 1 2 ft, PMUte^ MWi<n'MU FIG. 12 is a side view from the right-hand side 

jffi(^53l$5#^$lH~<5 ^ t side of the vehicles in which the perpendicular 

fcX*% hWM-^)j^\(O^MW^L^: visual-field region which the driver who rides on 

^1r^Wi<Dfc\%M^frb<D$\\!s\ the driver's seat of vehicles can recognize 

IH"Cfc-5o similarly is shown. 



[0 0 0 6] 

012 lc^-f «t o MW\<r>ff\ 
G#JgfiJfc$ft-Cl^S 0 £fc> * 

mtK mmftizmx-btitz;i<- 
j»^7-*nm-tZ)Z.k\ztv 



[0006] 

The perpendicular forward-vision field region G 
obtained by as shown in FIG. 12 the driver who 
rides on vehicles ahead of vehicles viewing 
directly is formed. 

Moreover, behind vehicles, the perpendicular 
back visual-field region H obtained by the driver 
who rides on vehicles viewing the room mirror 
with which vehicle-inside was equipped is 
formed. 

The other region is the blind-spot region which 
an driver cannot recognize. 
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[0 0 0 7] 

i^tifeJSI^ iiH, *pfif<z> 

iif? * ft & »f£ t * ft b 



[0007] 

Thus, the blind-spot region which is not 
obtained depending on recognizing viewing the 
front direction with the normal riding posture or 
a side-mirror, and a room mirror is formed in the 
perimeter of vehicles, when the driver in driving 
makes a course change the left or rightward, for 
example, after paying attention to the blind-spot 
region and intending the safety respectively 
towards the back blind-spot region F suitably 
formed in the side blind-spot region D formed in 
the lateral direction of vehicles, and back in the 
eyes ahead put in the normal operation posture, 
it must operate the running direction of vehicles, 
and when intending safety of a vehicles 
operation, there is a problem. 



[0 0 0 8] 

xm mrnrnz. urim* 

5 Z t J: o T^^l" 



[0008] 

Thus, there is a limit in the visual-field region 
obtained by a side-mirror (or fender mirror) and 
a room mirror with which vehicles were 
equipped. 

However, if a side-mirror is greatly comprised in 
order to reduce the blind-spot region, the ahead 
side blind-spot region E which it generates 
when a side-mirror exists will become bigger, 
moreover, it is not desirable from a viewpoint on 
the design of vehicles. 

Therefore, the side-mirror with which the 
present vehicles are equipped is designed by 
the compromise of a conflicting requirement 
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^tt&lFTlF'f from safety and design property, it does not 

2>&jR<D&ffl,MsX'%i&?&in* + provide sufficient safety. 



[0 0 0 9] 

T, #J;Ui\ #i¥7-2 2 3 
4 8 7^«^f4 % W K5 7 

X.T, CCD*>7^$SO^ 

* ¥ M ft <r> Wi JJM fcfll x. 5 fllric 
ft L"C SfcK-f - § r £ fl* -e # § (7) 



[0009] 

As an example which improves the limit of the 
visual-field region of such a side-mirror, it 
replaces with mirrors, such as a side-mirror and 
a room mirror, and attaches a CCD camera to 
the desired position of the exterior of vehicles, 
and an inside, and the composition which 
equips the ahead side of vehicle-inside with 
display means, such as a display which projects 
the image data acquired by this CCD camera, is 
disclosed by Unexamined-Japanese-Patent No. 
7-223487, for example. 

If it is made such composition, compared with 
the case where it makes mirrors, such as a 
side-mirror, project out of vehicles, it can form 
small the amount of projection of the CCD 
camera for acquiring the image of the side of 
vehicles etc., and is not necessary to turn eyes 
to the lateral direction of vehicles, and can 
check through display means by which the 
information on the side of vehicles etc. was 
provided at the ahead side of vehicles with the 
direction of eyes in a normal operation posture. 
Therefore, it can improve the safety at the time 
of vehicles operation. 



[0010] [0010] 

LfrLs ^cotij^T'fi, /hMC However, with this composition, the imaging 

C D 77 / y (DWLffc&aWZ-MVfktf range of a small CCD camera has limitation. 

h'O, ZZfiffiMi&i&i&'f&tilsb In order to reduce the blind-spot region, it is 
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necessary to have complicated and expensive 
composition, such as a change mechanism of a 
standard lens and a wide angle lens, and a 
rotation mechanism in which make a small CCD 
camera rotate and it adjusts the image pick-up 
region. 

Moreover, an driver has mind taken by the 
operation by operating such a complicated 
mechanism during operation of vehicles. 
Furthermore, in order to acquire a desired 
image, problems, such as requiring a long time, 
arise, and safety is impaired. 



[0011] 



[0011] 

Moreover, in order to attach a small CCD 
camera outside a car, it is required to provide 
the waterproof structure where rain water does 
not permeate. 

In order for the photographing means itself to 
enlarge for the waterproof structure, the design 
property of vehicles is impaired, furthermore, it 
becomes a problem also in respect of cost. 



[0 0 12] 

t LT, #12 0 0 0- 1 2 7 
8 5 o-^StfRKfi, Mm<oMM 



[0012] 

As composition which solves such a problem, it 
builds into Unexamined-Japanese-Patent No. 
2000-127850 the small CCD camera which 
detects the visual information of each side part 
of vehicles as an image to the side-mirror 
provided in the both sides of vehicles, and the 
composition which displays as an image the 
visual information which this CCD camera 
detected on the display means provided ahead 
of the driver is disclosed. 
With this composition, the visual information of 
the method of each side of right and left of 
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-5;ii:('iJ;o"Ct#£>tL3 vehicles and back is obtained by both the visual 

%ib^ /J^iC C D# / 7 [z. io information obtained by recognizing a 

XM^^ti^>^%\m (F)W.j5 side-mirror, and the visual information imaged 

Ciot^ &Wi<DtE.£<D&Mjj by a small CCD camera, it can operate vehicles, 

RTf'&ft(DU%\%W& "bft> checking the safety of vehicles. 

%m<D^± zmm t & & b mm 



[0 0 13] 

£fd, ^¥7- 1 8 6 8 3 1 

^-7> 

tcfr fc tti* »t 5 w t # 
ffi T* fc *5RI £ ft ft V i ft 



[0013] 

Moreover, let the mirror of a side mirror 
apparatus be a half mirror at 
Unexamined-Japanese-Patent No. 7-186831, 
the rear-and-side monitoring apparatus 
incorporating the camera which monitors the 
situation of the rear and side of vehicles to the 
back side of this half mirror is disclosed. 
It made it build a camera in the back side of a 
half mirror in the rear-and-side monitoring 
apparatus of this gazette. 
Therefore, it has composition which does not 
provide a new projection thing in the exterior of 
vehicles, and does not become 
disadvantageous in respect of a size and cost. 



[0 0 14] 



[0014] 



m 

±.B<D!$M¥-7 - 1 8 6 8 3 1 
2 0 0 0- 1 2 
7 8 5 O-^SR^ft^tlfcSE 



[PROBLEM TO BE SOLVED BY THE 
INVENTION] 

By composition described by above-mentioned 
Unexamined-Japanese-Patent No. 7-186831 
and each of Unexamined-Japanese-Patent No. 
2000-127850, it can project the visual 
information of the rear of vehicles, and a side 
part as an image. 

However, since such a small CCD camera has 
limitation in the imaging range, the optic area 
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region acquired using this CCD camera is 
nearly identical to the optic area region obtained 
by a side-mirror. 

Since the visual information about the back 
blind-spot region which exists the side 
blind-spot region which exists in each side of 
vehicles, and behind vehicles cannot be 
obtained and the visual information about the 
vehicles bottom cannot be obtained, with the 
composition of each said gazette, there is a 
problem that it cannot fully check the perimeter 
situation of vehicles. 



I0 0 1 5] 

mmo&MUfcWLft bin 

Khz mmzmmi- s tc t> ^ 

£-fft[±\ /MCCD*>7$: 

©she* znb<D\B]mmm 

•So 



[0015] 

Moreover, in order to solve the problem which 
has limitation in the imaging range of a 
miniature camera provided in each-side part of 
vehicles, the rotation mechanism for rotating the 
composition which can rotate the small CCD 
camera built into the mirror main body, then a 
small CCD camera is newly needed, there are 
also an apparatus's being complicated and a 
problem that safety is impaired by operating 
those rotation mechanisms during operation of 
vehicles etc. while becoming expensiveness. 



[0 0 16] 

fcSftfcfc Wilis 



[0016] 

This invention considered the above situation 
and was made. 

For example, it provides the vehicle perimeter 
display device by which the driver of vehicle can r 
grasp the perimeter situation of vehicle exactly 
based on the image information by two mirror 
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'tZ)~o(D&jji\L% / y\Z-£> 5 apparatus which project the rear image of both 
$i{&fff#l<t dg^^T, $iS](7} sides of vehicle, and image information by two 
ffiMVtU&tf)M\^MX*£ 3^ omnidirectional cameras which photograph the 
f^/iffl^^^E£^1&"t"5o image of the both sides and the bottom of 

vehicle. 



[0 0 17] [0017] 



[MEANS TO SOLVE THE PROBLEM] 

±f2iiJI£$r-$:lh 5 tibb, In order to solve the above-mentioned problem, 

the vehicle perimeter display device of this 

1^0 3 6 0° (D\^M^MLt^hX invention has the image pick-up part which 

^£ti&ft&fftfejjfii\^}x%ii~ photographs the reflection light which reflects 

^^t^lh t , f^7t^^T*g;itt" the light irradiated from the visual-field region of 

SSltTt^rSf^UT^^'filj^ maximum 360 degrees by the optical system 

x — 9 £Bxt#i~5#$fcp|5 t which it reflects in the prescribed direction, and 

U htitz& this optical system, and acquires 

'ftfiLfi ^ 7 t , %%ik1i\iLj3 ^ 7 omnidirectional image data, 

[dj: oT^gf^^H/c^^fiiUf^ It is provided near the omnidirectional camera 

t~-& £\ i^#>!xAE:£ titz^ffs provided in the side part of vehicles, the image 

ff^liOMf|£x~^K:|££H~5® data converter which converts into the image 

^cf— 9 bs ^fSj<7)ilfe data of a predetermined display type the 

t>ti, !£@H^x omnidirectional image data photographed with 

^^g£i&p|5^cfc oT§£#&£tifc this omnidirectional camera, and the driver of 

M^ffl^x*-^ 3r^^i~3il^ vehicles, it had the display section which 

%$t^ ?r{ix./c w t %W$L t i~ displays the conversion image data converted 

<5 t> <7) h 5> o by this image data converter. 

It is characterized by the above-mentioned. 

[0 0 18] [0018] 

±fS^^^co^ifS]ii[S^7^^g In the vehicle perimeter display device of 

Id&^T, mtZ1kjj{\LjJ 7 (i^ above-mentioned this invention, as for said 

(D&fccD&iM^fc^ ti^fti omnidirectional camera, it is desirable to each 

lx h ti X V >5 d t ft U £ L be provided in each-side part of right and left of 

V \ vehicles. 
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[0 0 19] [0019] 

±IE^5SW©*^ffl^^iSS In the vehicle perimeter display device of 

(cjoV^T, tufS^^fi^^ y (i^ above-mentioned this invention, as for said 

^^(D&fcoi&iMpb^^tl^tl omnidirectional camera, it is desirable to attach 

Ixtt btiZ> ? 7 — ^S^^fe^pP to the tip of the mirror apparatus each provided 

9 tttt ^tiXV^^ r £ # jf in each-side part of right and left of vehicles. 



[0 0 2 0] 



[0020] 

In the vehicle perimeter display device of 
above-mentioned this invention, as for said 
omnidirectional camera, it is desirable to each 
attach to the tip of the side-mirror each provided 
near a driver's seat and the front passenger 
seat in vehicles both sides. 



[0 0 2 1 ] [0021] 

±E^:^P^O^i^iilffi^^^tt In the vehicle perimeter display device of 

{z&\<^X ,mt£&jj{tL% J> 7 fi> above-mentioned this invention, as for said 

MW%^<D7 zc.y^—KWtfth omnidirectional camera, it is desirable to each 

ti£ 7 ^ 7 — <D^M% attach to the tip of the fender mirror provided in 

f^ft^tlBX !9 ft ft biiX^Z) the fender of a vehicles side part. 

[0 0 2 2] [0022] 

-hlS^^P^cD^f^jlffl^^^tt In the vehicle perimeter display device of 

fd&i^T, fuffl^^Jfi^ / 7 fix above-mentioned this invention, as for said 

jtijfE? y— ^§<Z)rt^(;i3fi^i& omnidirectional camera, it is desirable to 

£HT^5r «Jr^$f^ LV\ integrate in the inside of said mirror apparatus. 



[0 0 2 3] [0023] 

±fS;^W^^i^][g^^^fL In the vehicle perimeter display device of 

(d^oV^T. m^^JJitLti * 7© above-mentioned this invention, it is desirable 

Jt¥7k\$, J&^iEtfc£fcfi2Xft that the optical system of said omnidirectional 

Stfe^rofiMlElfeft: ^7 — \z.£. camera comprises the convex type rotary-body 
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iXffiffc&tiX^^&Z bffiftf-iZ mirror of parabolic sheet-like or hyperbolic 
IA\ sheet-like etc. 



[0 0 2 4] 

til $ ftfc^teHftr- * 



[0024] 

In the vehicle perimeter display device of 
above-mentioned this invention, as for said 
image data converter, it is desirable to convert 
into panorama image data or the perspection 
image data the omnidirectional image data 
photographed with said omnidirectional camera. 



[0 0 2 5 ] 

±m*mw (D&wim lapses 

ffiftrfS Zk^XV MffitDWfc 



[0025] 

In the vehicle perimeter display device of 
above-mentioned this invention, it is desirable 
by detecting action of a handle, a turn signal, 
etc. provided in vehicles in having further the 
operation detection part which detects the 
operation of vehicles, the operation information 
generation part which form operation 
information including the run direction of 
vehicles based on the detection result by this 
operation detection part, and the display control 
part which control the image displayed on said 
display section based on the operation 
information formed by said operation 
information generation part. 



[0 0 2 6] [0026] 

±IE*^P^»*^ffl*^S«fi In the vehicle perimeter display device of 

(djJol^T, buIE^^pB^H, bu above-mentioned this invention, it is desirable 
IfiiH^x— that the multiple-purpose information which 

IS&H^x — 9 b&\Z s 3t8&ife contains a road map in said display section with 

III&tatP#ll Wft $ftd $ HE±ld the conversion image data which said image 

^^cFttSd LV\> data converter converted is displayed on a 

screen. 
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[0 0 2 7] 



[0027] 

In the vehicle perimeter display device of 
above-mentioned this invention, it is desirable 
that have further the display range specification 
part which designates the desired display range 
in said conversion image displayed on the 
screen of said display section, and the image 
data of the display range designated by this 
display range specification part is enlarged and 
displayed on the screen of said display section. 



[0 0 2 8] 

?%7 u-^Wciii^Mirt 
xm It -t 5 Mr- 9 SElftgB 



[0028] 

In the vehicle perimeter display device of 
above-mentioned this invention, it carries out 
the pattern matching of each omnidirectional 
image data which got mixed up per frame and 
by which the updating memory was carried out 
to the image data storage part which carries out 
renewal of the omnidirectional image data 
photographed with said omnidirectional camera 
of sequential per frame, and stores it, and this 
image data storage part, it sees the 
moving-body detection part which detects the 
moving body close to vehicles, and the vehicles 
speedometer provided in vehicles, the 
moving-body speed measurement part which 
measures the speed which the moving body 
detected by this moving-body detection part 
transfers, when the speed of the moving body 
measured in this moving-body speed 
measurement part is approaching vehicles the 
speed more than a prescribed value, it is 
desirable to have further the alarm-output part 
which outputs an alarm or alarm information. 
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[0 0 2 9] [0029] 

±f£^^^ro$j5]J^ISg^;^g In the vehicle perimeter display device of 

Ci&^Tx f fe^AE^tifc^p'-fl above-mentioned this invention, it has further 

(Dtffi'fc^vi t Mit LT#Si the communication part which makes 

tff$B£:i2Hf i~5iii{f pP£t £ communication connection with the terminal 

fitx^ mt^W\fc%kft\v$fr, ^ unit of the exterior designated beforehand, and 

\ft}(DM%z&it&\z. t>fbfM~<5 J: transmits a variety of information, and said 

0 ^tx££tiT jo *9 , f^ljft: moving-body detection part is set up so that it 

^^q^/5^f^Wi£i23^Bf^B#r^ may operate also after the shutdown of 

&±lzt>tcr>X&T5:l'ti&W)t$ vehicles, when this moving-body detection part 

£r$*£fl LtcWoii^, i!ufcll£$&ttJ detects the moving body which approached 

^pP^^^^ If/^tB;/} near vehicles beyond over predetermined time, 

ituffiilif ptfKU; oT, ^ while a warning sound is outputted from said 

£fl L/cSibff^®^^—^ £r*a alarm-output part, the alarm information which 

tfli^fi $S/5^mjfSi^^^^fci^ contains the image data of the detected moving 

ff £tu ftj fflM^x^- ^ ISISpP body by said communication part is transmitted 

f±* f^S^^S(-i^ff L/cM^ to said terminal unit, as for said image data 

x — ^ ^rfStS'fS ^ i: L storage part, it is desirable to store the image 

V \ data which transmitted to this terminal unit. 

[0 0 3 0] [0030] 

£fc, ^^Pj^^i^jSlffl^Tj^ Moreover, the perimeter display method of 

fefi, ift^/UHlS 6 0° OHif vehicles of this invention is an omnidirectional 

fjfii§&^ h Att £ ti 5 3£ i k?J\tL'3i camera which has the image pick-up part which 
ipJfciSWi"?)^^^ photographs the reflection light which reflects 

T*JxWi~5>5!t;)t£$i^ LT£ the light irradiated from the visual-field region of 

jj{u.Wi^7 s —& £^#i~Sitii£ maximum 360 degrees by the optical system 

pfl t £W~t~<54^{u# ^y'k^ which it reflects in the prescribed direction, and 

$fS](7)fflp^(-!xtf\ t%±jj{iL% this optical system, and acquires 

/ y ?rfflt N TlS^$tlfc^i^tD omnidirectional image data, it provides in the 

M^RX$T%¥>$:^tf£j7{iLWiiMt side part of vehicles and converts into the 

x — ^Srffli^T, i^lxAEi^ti conversion image data of a predetermined 

tc^^j&M<D^^Wi^'r~-? display type using the omnidirectional image 

ItsW^M^ff— $ £r> data containing the side part and the lower part 

MW\oy-MM^^(D]5:i^\Z.WL^ btl of vehicles which were photographed using this 
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tc^:7F%$\c%:7jk-t Z> z. t omnidirectional camera, it displays this 

itSt^T'fc^o conversion image data on the display section in 

which it was provided near the driver of 

vehicles. 

It is characterized by the above-mentioned. 

[0 0 3 1 ] [0031] 

£fc, ^^B^W^MJ^ffl^F^ Moreover, the perimeter display program of 

p^7A(t ±rE^^^©$M vehicles of this invention performs the perimeter 

J^lffl^^;>7ft£:3!fr"f 5 1 0*C display method of vehicles of above-mentioned 

hh 0 this invention. 

[0 0 3 2] [0032] 

[%m<DWfa<DTtm\ [EMBODIMENT OF THE INVENTION] 

KT, ^^R<D^ffiMW&*j$k Hereafter, based on drawing, it demonstrates 

fKdoi^T, 0ffi^S<5V^Tf¥ the vehicle perimeter display device of this 

M\z%^M^h Q invention in detail. 

[0 0 3 3] [0033] 

El 5(1, ^WR<D^W\WiW\^i^ FIG. 5 shows the case where it attaches the 

5*@£r* — 0fl£ Lt, 3j^(DM vehicle perimeter display device of this 

ffiiJSRdBX V) Htf bti% x y — invention to the side-mirror which is the mirror 

g"Cfc 5 iM K 5 7 — l£EX 0 fl" apparatus attached to the both sides of vehicles 

ttfc^-n^^LTiotK (21 5 as an example, FIG.5(a) shows a top view and 

( a ) fit, ¥15[§k 0 5 ( b ) FIG.5(b) each shows the front elevation. 

[0 0 3 4] [0034] 

^k^K©¥MJ^IS^^^SIi^ The vehicle perimeter display device of this 

M 5 <fc o \z s &W)%^(D invention has the omnidirectional camera 4 

<:jS]5 0 <7)ffi{|iJ£P(di§:tt bft<5 which can photograph the visual-field region of 

^7^Sl5T*fc?)t^ 5 perimeter 360 degrees attached to the state 

—^tz&7x.l/&— x y — td&EL where it integrated in the side-mirror or fender 

^•iAAyff VtMKM 0 Htf bfritc mirror which is the mirror apparatus 5 provided 
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HIS 3 6 0° <OffiffiW$ t : fcWL& in the both sides of vehicles 50, such as an 

t #>"C# Z^kjiitLj] y 7 automobile, as shown in FIG. 5, and the display 

4 t > w (D^^jiiL^J ^ 7 4./^|g section 9 which displays the picture information 

^L/cM^tf ^£^^"^53^ which this omnidirectional camera 4 

£|59 i:^tLt^5 0 r^^M photographed. 

Hi^gltli, IkjiitLt) j> In this vehicle perimeter display device, the 

7 4 d «t o ~Cfll{|£ £ ti/c Itffeff picture information photographed with the 

<75Jl$c^ WflfF^ft'J omnidirectional camera 4 is displayed on the 

^<Dffititi<D{\LWfcffi^btitc%; display section 9 with which desired positions, 

^ptf 9 (^Tj^foSo -tU^<£ such as an ahead side of the driver's seat of 

V) , $fS] 5 0 L"tV5 vehicle-inside, were equipped. 

^^p|5 9 {^WiTF^ti Thereby, by recognizing the wide range image 

&fc^Wi<DW\il&&ffiW-1~Z) - t which a display section 9 is shown, the driver to 

[Ccfc 9 , ^Lffl 5 0 cDjSHli]£fl^F<7) whom operation etc. is carrying out vehicles 50 

W&ffift$:PEWztGMirZ)Zk can grasp visual informations, such as both 

j£f5BI(::;bfc5&£? # sides of vehicles 50, in detail, and can get the 

IEI?®i$£:#<5 - t &X*% 6 0 far-reaching good visual-field region. 



[0 0 3 5] [0035] 

^^(D^fSfMUg^^ggoHl With reference to the block diagram shown in 
P^f#/$(^oi^T. H 1 \Zjjkir7* FIG. 1, it demonstrates the outline composition 
p ^/^EI^#^UTlft^^5 0 of the vehicle perimeter display device of this 

invention. 



[0 0 3 6] [0036] 

^^^cD^jMlIliS^^^II 2 0 The vehicle perimeter display device 20 of this 

{3. fkl:fflffl3 6 0° <7)|SIHI invention is with the omnidirectional camera 4 

i$£rffli{t~f 5 CI <t /^~C# which can photograph the visual-field region of 

{iLii ^ 7 4 <D±.1oiiL$} ^ maximum 360 degrees, the control part 1 which 

7 A'RU^XT^^MWiWi^^^. controls each whole composition which 

12 0 £fSj^^3^fliJ&<7)^:f£ comprises this omnidirectional camera 4 and 

£rfrtf$1~3$y^pP 1 t > ^PJii the following vehicle perimeter display devices 

H^^^a 2 0 CD&mffc&WM 20, the program memory 2 which stores various 

"^S/cife^^S^^J^T'p 2*7 kinds of control programs for controlling each 

i*£I2l§i~<5 7 f> p ^7i^ * y composition of the vehicle perimeter display 

2 $iJ^^51^^J^l-f device 20, the buffer memory 3 which carries 
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ttf* 5 Mr - * ffitSSG 8 £ , 
^H®±(-^^-T5^^^ 9 

JftftMft*n<Bi 2(cj:6^^^m 

^g^VTffit^tr^lR)^ 
^1 3 »*^7 4|; 

«t o x M $ ti^Milfir- 
ftft&M 1 4 \z «t o $ 



out the updating memory of the various data 
which the control part 1 controls, the image data 
converter 6 which converts the image data 
acquired with all the direction camera 4 into the 
image of desired display types, such as the 
perspection conversion image and a panorama 
image, the conversion information storage part 
7 which stores information, such as a relation 
for converting into the image of a desired 
display type the image data photographed with 
the omnidirectional camera 4, and a constant, 
image data storage part 8 which stores the 
image data photographed with the 
omnidirectional camera 4, and the conversion 
image data made based on this image data, the 
display section 9 which displays on a screen the 
picked-up image photographed with the 
omnidirectional camera 4, and the conversion 
image converted based on this picked-up 
image, the display control part 10 which controls 
a display section 9, and the operation detection 
part 12 which detects operation by action of the 
handle with which vehicles were equipped, a 
turn signal, etc., the operation information 
generation part 13 which forms operation 
information, such as the run direction of 
vehicles, based on the detection result by this 
operation detection part 12, the display range 
specification part 11 which designates the 
display range of the picked-up-image data 
photographed with the omnidirectional camera 
4, the moving-body detection part 14 which 
detects the moving body which approaches 
vehicles from the picked-up-image data 
photographed by the omnidirectional camera 4, 
it has the moving-body speed measurement 
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IbffolSfi'J^SB 1 5ts part 15 which measures the speed of the 

£/cte#£&tf^£ffi^1-5#$B moving body detected by the moving-body 
tfi^SPl 6<t, ^gtti^l 6 detection part 14, the alarm-output part 16 
^ffi^^Sll^&fff $6£ri2Hf which outputs a warning sound or alarm 
iiff £fl 1 7 <tx information, the communication part 17 which 

<5'^ 1 8 t ^^Ltt^o transmits the alarm information which the 

alarm-output part 16 outputs, and bus 18 which 

connects each composition. 

[0 0 3 7] [0037] 

J^T\ &flfj$(-oV^Ttft^1~5o Hereafter, it demonstrates each composition. 

[0 0 3 8] [0038] 

^J5{tLt) / 7 4(coV^T First, it demonstrates the omnidirectional 
M(-tft^-f 5o camera 4 in detail. 

[0 0 3 9] [0039] 

i^J{£# ^ 7 4 ll N 0iJ^iH\ Wl The omnidirectional camera 4 is equipped with, 
^ffi^S/cti^ffiiSt^^flM for example, the optical system 4a which 
[U|S#;5; t^h^^it^rhA comprises a convex type rotary-body mirror of 
air, i^Wtfiv^s CCD*^ parabolic sheet-like, or hyperbolic sheet-like 
7, A/Dg£}^[eI8g, ®f^^a etc. and the image pick-up part 4b which has 
[e]S&2r^i-£H1Mi3 4 b t £{i the cover glass, a CCD camera, an A/D 
tti/^o fiMHIlSfr ^ converting circuit, and a picture-processing 

bft5)t¥5M a it, M±mm circuit. 

3 6 0° \^t>tz^>^)5\tL(D^M The optical system 4a which is made up of a 
^^Sc^ ; ^"^?)W:^Srii^p|5 4 b convex type rotary-body mirror points and 
(DC CD* / 7 <?):§7tffl^[p]tf projects the image which has the 
T&f£U fllftpMbfi, 7fc^ omnidirectional visual-field region covering 
%4 afrb1&&£tltz$:$L$:£ maximum perimeter 360 degrees on the 
jj{iLW\iML7 s — 2 t LTtHft1~ light-receiving surface of the CCD camera of 
So the image pick-up part 4b, the image pick-up 

part 4b photographs the image projected from 
the optical system 4a as omnidirectional image 
data. 
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[0 0 4 0] [0040] 

Z<D X o S^jjiiL The omnidirectional camera 4 which has such 

*>7 4li MMO&fcO&M composition is built into each mirror apparatus, 

£M<ii§:tt btifclM K ^ 7— $ such as a side-mirror provided in each-side part 

felt? i y 5 7 —^(D-^ti of right and left of vehicles, or a fender mirror. 

?ti<D\ 7-mmzm.%-&*}n 
z> 0 



[0 0 4 1 ] 

m2it, *m k 5 7—^<d $ 7 
-mm 5 \z*%wimz>±*{iL 

%/7 4 ^m.^Th^ti^M(D- 
MZ^l>Xt3<0. HI 2 (a) 

7-mw5\^%w^&z>£% 
Tr^w-mm, m2 (b) m 

2(a) (D^^^^^fflffiHI, 
HI 2 (c) fi, HI 2 (a) Otl 
(1212 (a) {C*5^-CT» 



[0041] 

FIG. 2 shows an example in the state where it 
integrated the omnidirectional camera 4 based 
on this invention to the mirror apparatus 5, such 
as a side-mirror, the side view which looked at 
the top view showing the state where FIG.2(a) 
built the omnidirectional camera 5 based on this 
invention into the mirror apparatus 5 attached to 
the right-hand side of vehicles, and FIG.2(b) 
from the right side of FIG.2(a), and FIG.2(c) are 
the side views seen from the back (it is the 
bottom in FIG2(a)) of FIG.2(a). 



[0 0 4 2] 

^7-gl5tt, El 2 (a) ~ 

(c) ^fteh^-r<fc 9 
5 b (D'&ffi&msm o «fc o 

-So ;©M^5 c faiai, M 

trrstt&s 1 cimmnx 



[0042] 

The mirror apparatus 5 has the 
rectangle-shaped mirror 5a which projects the 
visual information of the prescribed range, as 
each shown in FIG.2(a)-(c), it attaches so that 
the rear surface of Housing 5b provided in the 
form of a rectangular parallelepiped may be 
covered roughly. 

This housing 5b is attached so that it may 
project in the method of each side of the right 
and left of vehicles to attachment 5c provided in 
the vehicles side part. 

In this attachment 5c, the axial part 51c which 
supports the end side of Housing 5b rotatably is 



8/3/2006 



28/72 Copyright (C) 2006 The Thomson Corporation. 



1 c ^7k¥-jjfa\z\B\m^ 

m\z5;ft&titzBfc5 bit, ^ 
£ tix KM $ ^c{ig (c @ £ $ 

o° (offirnxmrn^mz-te^x 

-mW 5©ff»5b WftffiliCS: 

mP5dfi, *SrSiai-*SW 
7° 7 * 5 1 y * * fcfiSftttttR 

Wft Sr/£ < fiJffl-f 5 r ^T* 



provided in the perpendicular state, housing 5b 
supported so that it could rotate to the axial part 
51c of Attachment 5c horizontally is roughly 
fixed to the side part of vehicles by the 
orthogonal direction at the time of use of the 
mirror apparatus 5 (in the case of a vehicles 
run), it is fixed to the position folded up and 
accommodated in the direction in alignment r ^ 
with the side part of vehicles at the time (when 
making vehicles park a car) of un-using of the 
mirror apparatus 5, it can rotate now in the 
range of about 90 degrees. 
5d of retainers holding the omnidirectional 
camera 4 is provided in the tip of Housing 5b. 
5d of retainers holding the front-end side of 
housing 5b of the mirror apparatus 5 and the 
omnidirectional camera 4 covers the 
omnidirectional camera 4, and they comprise 
the transparent plastics or transparent matter 
which pass through a light, by such 
composition, it can utilize widely the viewing 
angle which the omnidirectional camera 4 has, 
and it can form in the waterproof structure so 
that rain water may not permeate. 



[0 0 4 3] 

-sat 5 (D&ftn s d \z$m l 



[0043] 

FIG. 3 is the perspective diagram of the 

principal part showing the state where it 

maintained the omnidirectional camera 4 to 5d 

of retainers of the mirror apparatus 5. 

Here, 5d of retainers and Housing 5b holding 

the omnidirectional camera 4 are formed 

integrally. 
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^7, A/D^&Hlif&, MM 
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^74 3»8fg& 5 d 



[0044] 

As shown in FIG. 3, 5d of retainers holding the 
omnidirectional camera 4 will be projected up. 
The upperside of Housing 5b is curving toward 
upper direction so that the upper part of 5d of 
retainers which project up may be covered. 
As for the omnidirectional camera 4 
accommodated in this retainer 5d, the optical 
system 4a formed by the convex type 
rotary-body mirror of parabolic sheet-like or 
hyperbolic sheet-like etc. is retained at 5d top 
side of retainers, directing a protrusion part 
downward. 

The image pick-up part 4b which has the cover 
glass, a CCD camera, an A/D converting circuit, 
a picture-processing circuit, etc. turns the 
light-receiving surface up, and sets it in Retainer 
5d, it is maintained under the optical system 4a. 
In the example shown in this FIG. 3, since 5d of 
retainers holding the omnidirectional camera 4 
has projected up rather than parts other than 
the upperside of housing 5b which covers 5d of 
retainers, the wide range visual-field region is 
acquirable as picture information by arranging 
the optical systems 4a, such as a convex type 
rotary-body mirror, at the part projected to that 
upper direction. 



[0 0 4 5] 

-mm 5 <D%nn 5 d \mn t 
UtiLt ^74 *imirzimn 



[0045] 

FIG. 4 is the perspective diagram showing the 
other example which maintained the 
omnidirectional camera 4 to 5d of retainers of 
the mirror apparatus 5. 

5d of retainers and Housing 5b holding the 
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5 d tWPf 5 b t fi— omnidirectional camera 4 are integrally formed 

$tiXV N 6o like the example of FIG 3 also here. 

[0 0 4 6] [0046] 

El 4 (CTF-f #J~Cf±. £3j{iL% / In the example shown in FIG. 4, the height of 5d 

7 4 £{£f#1~5$;f£qtf 5 d cDi^ of retainers holding the omnidirectional camera 

^gffcSbif^Ci!^ 4 is formed in the same height as Housing 5b, 

£foX & V , r <Di£W*$ 5 d CO the optical systems 4a, such as a convex type 

±£)5(vL x t£blti[H]$Sf£ 5; 7 —¥£(0 rotary-body mirror, point a protrusion part to the 

4 a ^£b^^rT^{^|p]^ upper part of 5d of this retainer below, and are 

T{£^£tLTl^o {fcf^Sd maintained at it. 

fiUZ-istf&yt^^ 4 a (DTJj^ Under the optical system 4a in Retainer 5d, the 

11^35 4 b ^^^S^E^r image pick-up part 4b turns the light-receiving 

±$]tc LTi^^ftTV^o £ surface up, and is maintained. 

tz, r (Di4 (DffilXlt, ^tft/^ Moreover, in the example of this FIG 4, the 

b(7))t^)t^^4a(l+5)l^ whole of 5d of retainers is formed of the 

Jfrfh CI t fcXXi* S J: 5 ^> transparent plastics which pass through a light 

{£frf£B 5 d <D4H$^7t£jSii"t" so that fully receiving may appear in an optical 

^Wft firfy * ^ v # K £ *) % system 4a and the light from the outside may be 

fifc^tiT^So made to it. 

[0 0 4 7] [0047] 

r(D[El4 ^^i"0iJTiix ^£fnft In the example shown in this FIG 4, since the 

5 d <D±M t fH 5 b (D±M t upperside of 5d of retainers and the upperside 

Cm&\z.j&J& l £tiX\/ y >Z>tz of Housing 5b are formed in the same height, 

Jt^rkA afcioTttbti the visual-field region obtained by an optical 

5ffiSHSJ£a s ff# SbCiot system 4a is reduced a little with Housing 5b. 

^Fffij^tiS/^ $;ff£|5 5 d However, the visual-field region large enough is 

<D&fcfci&Vfi[zM$ l &tiX\'^Z) securable for the outer side of the mirror 

-il-iot, ^ 7—%Wl 5 <D apparatus 5 by comprising the whole of 5d of 

^filt+^tcjE:v^!ff«4SS:* retainers transparently. 

SltiK^So £ x Moreover, when 5d of retainers has covered the 

f#Sfl 5 d fc£35$L% * y 4 <D<£ whole omnidirectional camera 4, it has the 

ft^Sotl/^^ <i: J; 9^ P waterproof structure where rain water etc. does 

*^8AL4^J:5 4K*i notpermeate. 
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[0048] 

In addition, since it is desirable from the point 
on a design to provide too much from the side of 
vehicles so that there may be no relish as for 
the mirror apparatus 5, mirror 5a attached to the 
rear surface of Housing 5b consists of half 
mirrors, it is sufficient to make it arrange the 
omnidirectional camera 4 between Housing 5b 
and Mirror 5a. 

In this case, since the normal of Mirror 5a 
having the reflectance ratio of 35 % or more on 
an industrial standard (JIS-D5797) is carried 
out, the quantities of light of the light which 
passes through a half mirror becomes 65 % or 
less. 

However, even if the quantities of light of the 
light which passes through a half mirror is 
limited in this way, the image pick-up part 4b of 
the omnidirectional camera 4 can form the 
image which was fully excellent in visibility with 
adjustment of sensitivity, and adjustment of a 
picture processing. 



[0 0 4 9] 

fi, ft^SfU a £fff$5 b<D± 



[0049] 

Moreover, the omnidirectional camera 4 
maintained at 5d of retainers of the mirror 
apparatus 5 is good also as composition which 
it maintains so that it may project from the upper 
end of Housing 5b to upper part and an optical 
system 4a can be slid to vertical direction. 
It can acquire an in this way, still wide range 
perimeter image. 



[0 0 5 0] [0050] 

U 5 (cfi, ilEtftfifeco^^iTJ When the omnidirectional camera of the 
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^ 7 £ s $jfi]<D jSHffi]gI${£flX 19 ft* above-mentioned composition is attached to the 

bti<5 5 7 — ^{E"Cfo<5lM side-mirror which is the mirror apparatus 

7 — K&9ttWc4§-£\ $ attached to the both sides of vehicles, the 

j^l;i^:>^53l(s#j&^#5 CI t visual-field region which the driver who rides 

X § § IJUf £r ^ L T V * vehicles can get is shown in FIG. 5. 

So 

[0 0 5 1] [0051] 

El 5 (a) &t>* (b) Tii, ¥ FIG.5(a) and (b) show the passenger car as an 

5 0 (7)0!J <b LT^ffl$£r^ L example of vehicles 50, the driver in vehicles 50 

X to 9 > 5 0 <DS$c#fi* can get the visual-field region on the backside 

7py K5 1 £ri§ LT from the rear window 52 of the vehicles rear by 

SCSc B 31 1£ i *9 jtu^^l&lHMiS the room mirror (not shown) which could obtain 

;i kfcXi* , the front visual-field region by direct 

F^ftiHR^^^f-lxtf htltzsis visual-observation through the front window 51, 

-A^7- (El^itT) Cio and was provided in the front-side center 

SiW&plStf) y 7 £ -Y y K 5 section of vehicle-inside. 

2 <t t) !&5iiy<7)#tlffJJ$£t#5 It can recognize the image photographed with 

Z b&X% Z>o ^JjitLti^yA the omnidirectional camera 4 by the display 

KiioTft^^fafcW^fi, $ section 9 provided in the ahead side of 

m\H<Dml5\n\Z-Wltf btitcm^ vehicle-inside. 

Iff 9 (c J: o TSK^S <h Moreover, in the example shown in this FIG. 5, 

#<5 0 $.tz % Z<D\%\ 5 \ZX7Fir the side-mirror 5 which is a mirror apparatus 

&lXit, ^ y—^WtXfo&y-'f shall each be attached to the neighboring both 

K^y^-5ti, yuyh^-<y sides of the front window 51. 

K5 1 (DfomtDMm^tiJfti 
IS flf+tt fc-fiT^Sfc Oil- 
So 

[0 0 5 2] [0052] 

H5 (a) M&V^Tfl, ^i^5 In FIG5(a), the range surrounded by an 

0 Offijlij^^Bxft-tf h tifc-tti alternate long and short dash line expresses the 

^tUD-y-^ 7— 5 Ciot visual-field region k obtained by each 

#bft5&!fff!g*£k — ££l side-mirror 5 attached to the both sides of 

Hfc£oTffl*;h,3ttlflfcJ:o vehicles 50. 

T^LTV^So ^fcs l£lo{iLl} Moreover, the range surrounded by a dotte* 
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15 (b) T'fi, 

^ «t o T # fb ix 5 &!?{gJ$ n 



line expresses the visual-field region m 
obtained by the omnidirectional camera 4. 
Moreover, the range surrounded by a dotted 
line expresses the visual-field region n obtained 
by an omnidirectional camera in FIG.5(b). 



[0 0 5 3] 

0 5 (a) £tW5£, 

tin* * y 4 iz «t o T# bftSS 

8 0° .£Jl±(C;bfc5J£tEiaw!ja 
if 3 6 ©«»S«k am&fLT 

>f h'5 7-5«W:J:ot(i# 

v ^ v ^is {d t> tc z> urn 



[0053] 

As for the visual-field region obtained by the 
omnidirectional camera 4, refering to FIG.5(a) 
obtains the visual-field region k of wide range 
viewing-angle (theta) more than covering 180 
degrees centering on the position where the 
omnidirectional camera 4 has been arranged. 
For this reason, it can obtain the visual-field 
region covering the wide range which is not 
obtained only with a side-mirror 5 by 
recognizing the image data photographed with 
the omnidirectional camera 4. 



[0 0 5 4] 

Sfc, 05 (b) fc^$*i5«k 

1 0° , T^l-8 0° KfrfcS 
SIM * n £ 

7 4{CioT, 

T^fiKfc, W«^*£7ci- 

m n IbJ tw*J" LTT7J <D 



[0054] 

Moreover, as shown in FIG.5(b), it can obtain 
the large visual-field region also in the vertical 
direction by the image data which the 
omnidirectional camera 4 photographs, and can 
obtain the visual-field region n of viewing-angle 
(phi) covering 10 degrees upward direction and 
80 degrees downward direction horizontally. 
From this, the visual-field region is expandable 
not only to the method of each side of right and 
left of vehicles but vertical direction with the 
omnidirectional camera 4. 
Particularly, the downward visual-field region 
opposed to the horizontal direction of the 
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titiHM^fi, %$k(OCCDjJ / visual-field region n is the visual-field region 
^Tiit#5 Cl t j5 s ~C# ftv^jUBF which cannot be obtained by the conventional 
fl^ScTfoSo CCD camera. 



[0 0 5 5] [0055] 

Z.<D& o \z LT^Ii*^ 7 4 Thus, the omnidirectional image data obtained 

J: <9 t#btL6^:^{iLCDSj^x by the omnidirectional camera 4 is converted 

— Pit, /V^I^ 3f8l@i into the desired conversion image of drivers, 

^#(7)jl^#(D^fM<7)^^iS^ such as a panorama image and the perspection 

Mfc%t<Dmjj%£ image, it displays on the display section 9 

f £ ti 5 SB 9 (-^^ £ installed ahead of an driver etc. 
tt5o 



[0 0 5 6] [0056] 

iSfcfc:, Z-(Di£3j\\Ll3 * 7 4 tdf^ Next, it demonstrates the optical systems 4a, 

ffl ^tiSdiMdlte^ 5 7 such as a convex type rotary-body mirror used 

3fcd^4 a (do^Tfft$li~5o for this omnidirectional camera 4. 

[0 0 5 7] [0057] 

HI 6 f±, 1&jiiLt) / 7 4 M^ffl FIG. 6 is the outline block diagram showing the 

$ 4 a Xfoh&WM composition of a hyperboloid mirror as a convex 

fefr^7-i: LTSii^ 7- type rotary-body mirror which is the optical 

<D% f&&^1~M^Mf&MX*fo system 4a used for the omnidirectional camera 

5o 4. 



[0 0 5 8] 

[16 7 — it, 7K 

X, ZttSrttii-a^iHiitftSrZ 

(X 2 +Y 2 ) /a 2 -Z 2 /b 2 = 
- 1 



[0058] 

In the three-dimensional space which makes 
the hyperboloid mirror shown in FIG 6 the 
Z-axis which intersects perpendicularly to the 
X-axis and Y-axis which intersect 
perpendicularly mutually, and horizontal surface 
on a horizontal surface, it is one shown by Z> 0 
in the hyperbola centering on a Z-axis among 
two hyperboloid of two sheets obtained by 
rotating a Z-axis as a core. 
(X 2 +Y 2 )/a 2 -Z 2 /b 2 =-1) 
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c 2 =a 2 +b 2 C 2 =a 2 +b 2 

fCT^£ti5 0 Z<Di:i\Z-$t& It is expressed with these. 

Thus, the hyperboloid mirror 4a comprises 

£rJf£fi5c~t~<5 t M i o ® forming a mirror surface in the whole surface of 

;7^4a # s #tJijGc?jfx<5o the hyperboloid expressed. 

[0 0 5 9] [0059] 

±f2xC(djol/^T N a&O* In addition, in said Formula, a and b are 

b fi^tt® 5 7— OSftffiOJK constants decided with the shape of the 

ttfcio-C**bti5J£ft"Cfe hyperboloid of a hyperboloid mirror. 

9 , c fiZl ffiW^^S:^ C shows the focus of hyperboloid of two sheets. 

LTi/^o _bf2it^octt^ZOx^ Conversion information, such as a constant 

l-M#>1-££l&^<7)^1&tf$B related to said Formula and this equation, is 

14* $Bfflft#15 7 beforehand stored in the below-mentioned 

^ fclEUt £ tLT V ^ <5 o conversion information storage part 7. 

[0 0 6 0] [0060] 

Z (D^ft® 5 y— "Cfi % J^^O By this hyperboloid mirror, it sandwiches an 

£#eA/T\ Sgfit c (Dfigtc 2 o origin point O and each has two focus F1s and 

(DM&F 1 RtfF 2 Z^ti^ti F2 in the position of Distance c, the light which 

W LT*3 9 , £ tf>3Kftffifl)*Mft goes to focus F1 by the side of the hyperboloid 

*^^3XftffiWW^^F 1 fci|n|d^ from the exterior of this hyperboloid is reflected 

bitfes 2Xft® 5; 7-^T5W by a hyperboloid mirror, even if it is the light 

£*vt\ ifO^lRj^feRSItStt irradiated from which direction, it has the 

tz%XhiX h J £Xi&j3<DMj& characteristics of going to the focus F2 of 

F 2 (C|p]/^ ob^o 4#8fc£W L another side altogether. 

[0 0 6 1 ] [0061] 

Lfc^oT, tg^uvX4b© Therefore, it is while coinciding the 

^r^ffiSr, 25^33 5 light-receiving surface of the image pick-up lens 

M (Ztt) tlM4broi§ 4b with the rotation axis (Z-axis) of a 

l^vX©*tti:-S$-e:5i^ hyperboloid mirror, and the optical axis of the 

lz s fdl^^^^F 2 image pick-up lens of the image pick-up part 4b, 

^ uyXrol 1 8ti"5 by arranging so that the 1st principal point of an 

i b MIfl{ii~5 Z t {^J: 9 , i£b image pick-up lens may be in agreement with 
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the position of the focus F2 of another side, the 
image similar to the state pointed to all lines of 
sight by making one focus F1 into a viewpoint 
position is acquired by the image pick-up part 
4b which photographs the light reflected by the 
convex type rotary-body mirror. 



[0 0 6 2] [0062] 

fttl^el3 4 b "Cfi N In the image pick-up part 4b, it photographs the 

t^fef^tiTcB&^&r, ^Wtfly image projected on the hyperboloid mirror as 

^> CCD*^7, CMOS^r omnidirectional image data by the solid-state 

b t£ <5 S^^^^^f- K X o image sensing device which is made up of the 

T\ £jftfL.M$L7 i — 9 t LTflt cover glass, a CCD camera, CMOS, etc. 

[0 0 6 3] [0063] 

fc%W<DMWffl%l&7F$£ Next, based on FIG. 1, it gives sequential 

UtoHtExXoi^T, WlPM 1 tc explanation about the composition of the 

S^v^ Ji||&f$f,f!£|-t"<5 0 vehicles periphery display device of this 

invention again. 



[0 0 6 4] 

-^©CPU, MPU^Cio 

OM, RPR OM % yyyi/zi. 



[0064] 

The control part 1 comprises CPU of a 
computer, MPU, etc., for example. 
Moreover, the program memory 2 comprises 
ROM, RPROM, the flash memory, the hard disk, 
etc., for example. 



[0 0 6 5] [0065] 

7° p if 7 A / ^ y 2(1, MW<D The program memory 2 each projects the back 

PSflMffiOft^Sr-ttb^Jxlftl^l - of the both sides of vehicles, while having the 

5 <£ o {c, $pf(Dj^fIij^P(c^ti program which photographs the method of each 

^'tiixtt bftfc 2 oco ^ 7—^ side of right and left of vehicles, and a lower 

H 5 l^ft^Jx^I^&^ftfc 2 image as omnidirectional image data using two 
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omnidirectional cameras 4 each built into two 
mirror apparatus 5 each provided in the both 
sides of vehicles, the program for converting 
into the image data of a predetermined display 
type the omnidirectional image data each 
photographed with each omnidirectional 
camera 4 by the below-mentioned image data 
converter 6, and the below-mentioned display 
control part 10, it has the program for displaying 
the converted conversion image data on the 
screen of a display section 9 in which it was 
provided ahead of driver's-seat of vehicle. 
The control part 1 each controls each 
composition of the omnidirectional camera 4, 
the image data converter 6, and display-section 
9 grade by performing such various kinds of 
programs. 



[0 0 6 6] [0066] 

^777^^!) 3(1 $lx.fi\ A buffer memory 3 comprises RAMs, for 

R AMT'jS^ £ ti, M'0 bB 1 \Z example, it updates and stores the various data 

J: o X M'M £ titz&M7 — ? £ controlled by the control part 1 . 



[0 0 6 7] 

mm? r - * mk-f p >f 7 j» *u 
ttLxi^o tit. ^mmm 

H^7il, ROM, E 

PROM, 77^^^!), 

ZtiX&V, &W\B\&fc^7- 



[0067] 

The image data converter 6 stores the image 
data conversion program, for example. 
Moreover, the conversion information storage 
part 7 comprises ROM, EPROM, the flash 
memory, the hard disk, etc., for example, it 
stores the conversion information containing a 
relation and a constant required in order to 
convert into a conversion image the 
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fc^^fuM^x— 9&$£$M$L omnidirectional image data photographed by 
^f^t2)fcfe^£^^PM^ the optical systems 4a, such as a convex type 
XV3£«fcSr^tP«»ttf «SrlBtt rotary-body mirror. 



[0 0 6 8] 



LTA^U rwA^HHtx- 



[0068] 

The image data converter 6 inputs the 
omnidirectional image data photographed by 
each omnidirectional camera 4 as input image 
data by control of the control part 1 , based on 
the conversion information stored in the 
conversion information storage part 7, it 
converts this input image data into the image of 
desired display types, such as panorama image 
data and the perspection image data. 



[0 0 6 9] [0069] 

Iiil7f3\ ±.^{tLlJ ^ 7 4 dcfco FIG. 7 is a schematic diagram explaining the 

X WiB&£fri fe&^iiLM&T-**- 9 method to convert into a panorama image the 

?:/V7-7li(:Mt?)M omnidirectional image data imaged with the 

£tft^1~5M^"?fo^ El 7 omnidirectional camera 4. 

( a ) Its ^jjiiLlJ ?*> 7 4 [d <k FIG.7(a) shows the omnidirectional image data 

<>XWi&£titz£%iiLW1&7 s — 31 photographed with the omnidirectional 

9 3 1 £^ U M 7 ( b ) fi, camera 4, FIG.7(b) shows the image data 32 of 

9 6 j&S8£tfePHfe the ring shape in the middle of the image data 

ffitipfl 7 (^ffilS^tife^^tf $i converter 6 cutting open omnidirectional image 

{z&<5\/^X£%iiLW1£LT~-9 : fc data in a panorama image based on the 

y<y 7-?W\%{z$l *) M < i&'fMd conversion information stored in the conversion 

fctfS y ^tfcroHlfe^— ^ 3 image storage part 7, FIG.7(c) shows the 

2£ttfL, [217 (c) fit, !iy rectangle-shaped panorama image data 33 

^^WMf^x — ^ 3 2 $ b further converted in the image data 32 of a ring 

fd, ^^H^ffiUpB 7 MiBlS£ shape based on the conversion information 

ixfciSgJ&W ^t-S^V>T^^$ stored in the conversion image storage part 7. 

* 3 3^LTt^ 0 
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[0 0 7 0] 

0 7 (a) Idfc^T, £P (r, 

ffiSEffi T*^ L £ ti 5 ill If £^ L 
TV^So i7 (c) K:*5tt3/£ 
P (X, Y) (4, XYllt*^ 

,6P (X, Y) (4, lfflgEffij&ffi 
T'^£ti5,ftP (r, fl) 

±<D&P (r, 0) ^/7-7 

vMft±»^P (x, Y) \zM. 

P0 (rO, AO) It i 



[0070] 

In FIG.7(a), point P (r, (theta)) shows the pixel 

shown by the polar coordinate on 

omnidirectional image data. 

The point P in FIG.7(c) (X, Y) shows the pixel 

shown with XY coordinates. 

This point P (X, Y) is corresponding to the point 

P (r, (theta)) shown by said polar coordinate, 

when the point P on omnidirectional image data 

(r, (theta)) is converted into a panorama image, 

it means converting into the point P on a 

panorama image (X, Y). 

Moreover, P0 (rO, (theta)O) shows the reference 
point at the time of cutting open omnidirectional 
image data in a panorama image. 



[0 0 7 1 ] 

/ y 4 «t o t|| £ 

fiilftx- 9 £ -t <o * * s^-r 

y~?M$L, fflSLW 

o^Tf4 % #M¥6 - 2 9 5 3 
3 3^#fcg*»WftWLTV> 



[0071] 

The omnidirectional image data imaged with the 
omnidirectional camera 4 is a circular image. 
In order to obtain an exact visual information in 
practice, it is an image hard to see. 
Therefore, on the screen of a display section 9, 
it does not display the omnidirectional image 
data which is a circular image as it is, but it 
converts this omnidirectional image data into 
conversion images, such as a panorama image 
and the perspection image, and displays on the 
screen of a display section 9. 
However, it is demonstrating the detail of the 
conversion method to the perspection image 
data of omnidirectional image data to 
Unexamined-Japanese-Patent No. 6-295333 in 
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Z>(DX\ ZZX'lt. #M¥6- detail. 

2 9 5 3 3 3-§-^#{dfeii^ti Therefore, here, it omits the detailed 
tzW$35''te. i k%l!@c$ *<5 t L"C\ explanation noting that the conversion method 
^(DWm^WLW-i^^^o described by Unexamined-Japanese-Patent 

No. 6-295333 is seen. 



[0 0 7 2] 

W&T - * 6 T« £ 

^{£#^ 7 4 7^ 1M K?7- 
<%<D* 7Hgfi5c7)gft5 bl£ 

^c«-e^#tt h interna. 

«fe ^ & o xum £ n 5 fc * , 

-TJ: ?lc, 0&l 8 0° 

x-^fi, HlfSieKi.MflO (X 
0, Y0) 8 0° 



[0072] 

Panorama image data converted by the image 
data converter 6, visual-field region 
photographed with the omnidirectional camera 
4 when the omnidirectional camera 4 is 
attached in the state where it accommodated in 
retainer 5d which adjoins housing 5b of the 
mirror apparatus 5, such as a side-mirror, since 
Housing 5b constitutes an obstruction and is 
limited, as shown in FIG. 5, the region actually 
photographed by omnidirectional image data 
turns into region of about 180 degrees. 
Therefore, omnidirectional image data turns into 
semicircle-like image data which has the 
visual-field region of about 180 degrees 
centering on Coordinates O (X0, Y0) in fact, the 
panorama image data which cuts open the 
circular image and is converted turns into image 
data from which the axis of abscissa became 
half roughly. 



[0 0 7 3] [0073] 

pj^-r ^ ^ laHpfP 8 The image data storage part 8 comprises 

RAMT'fifJS)t$H-5o w©B<fe RAMs, for example. 

x — £ IStS^P 8 (i % ffl'Mffi 1 (D This image data storage part 8 is equipped with 

rfrJWc: X WW] &titz& 'iti the region which stores conversion image data 

13 * 7 4 (c«t 9 W&.£Mz.iLlo converted by the region and the image data 

{iSH^T — 9 £7 v—]*^$LX converter 6 which carry out the renewal 
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)iI^HfffStti"S^^^t>*®^ memory of the omnidirectional image data 

7 — 9 W$k¥& 6 \z_ J: o T!£l& L photographed with each omnidirectional 

tc;<S 7 ^Uff 7~ ^ ifliM camera 4 actuated by control of the control part 

^^W^^H^-r — ^ £ 1 of sequential per frame, such as panorama 

fSlSi'Sfl^^riix.Ti/^o image data and the perspection image data. 

[0 0 7 4] [0074] 

^tf£P9 (i, 0!lx.f±\ LCD ($ A display section 9 comprises image display 

tfl-r ^^l^h PD apparatus, such as LCD (liquid crystal display) 

v • r ^ * 7° W ) ^(DM^M and PD (plasma display), for example. 

[0 0 7 5] [0075] 

r O^^^P 9 fi % al^j^tu^tc This display section 9 is installed in the position 

WtW^fotzJ^— A ^ ^^MifiiSc where the position which adjoins the position 

i~%{\L\SL, ^fcfi-^rWT^x £ close to the room mirror installed ahead of 

tcity^y K/W£|p^^~<5{iL§^ driver's-seat, its downward direction, or a 

(DpjfM^M^^g^tbSo handle is desired. 



[0 0 7 6] 

try— v'a V-y7s"r 



[0076] 

Moreover, it is sufficient to comprise this display 
section 9 so that it may share with the display 
section of a car-navigation system in common. 
In this case, it becomes possible to project the 
map information obtained by a car-navigation 
system on the same screen as photographed 
picture information with the omnidirectional 
camera 4. 



[0 0 7 7 ] [0077] 

feiSy ^tf£|5 9 — ~f- try— In addition, if the information displayed on the 

i/a y^r i*£)^7Fg|5£rit^ same screen as the picture information of a 

J: o Mfflf J^ftTV^SH^ display section 9 is not limited to the 

^tfSR 9 <DM^k\n W\~ above-mentioned map information but other 

cOHSitvi^^^^Stf ^tts multiple-purpose information is displayed on a 
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±Tfc(DMM\nW^B.fe&fo'T. screen when it is comprised so that a display 

ftiiCO^Il ^tf$fi£r!J[Ij{^^£ section 9 may share the display section of a 

ti<5 J: b l£"t" 9 <7) car-navigation system, it can make the 

fiJ{^t4?r £ibMfn]±£-ti:-5i<i: efficiency of a display section 9 improve further. 



[0 0 7 8] 

l^ittl 0(4, MiLtf, $ 
^ $y w -f p ^ 7 A * I Bit L T ^ 

o m^i-zm^mm?* 9*7 



[0078] 

The display control part 10 stores the display 
control program, for example. 
A display section 9 displays conversion images 
converted from omnidirectional image data, 
such as panorama image data and the 
perspection image data, based on the display 
control program which a display control part 10 
stores. 



[0 0 7 9] 

m*mmm&%> 1 1 it. 



[0079] 

The display range specification part 11 is 
equipped with the composition which can 
designate the display range from the image 
data displayed on the screen of a display 
section 9, for example, a key switch, and the 
touch panel formed on the screen. 
When the display range is designated by this 
display range specification part 11, a display 
control part 10 carries out the enlarged display 
of the image data of that designated display 
range. 



[0 0 8 0] [0080] 

H8f4 x W&B<Omjj\z.WtM.£ FIG. 8 is the top view showing an example 

ti^f^pfl 9 IdpHfe'r — 9 which displays image data on the display 

"t* £ — 0iJ^r^i"¥®IH"C$) section 9 installed ahead of a driver's seat. 

<5 0 



[0 0 8 1] 



[0081] 
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^ tC <fc o £ tLfc i®sa 9 
O^ffM^tlTfeO . ^WlJffi 
£B9 0(i, £11®^$ 9 0 a 
&t>*£iiilM« 9 0 b (D 2 o 

* b 2 ftm LXWi <b tl 
X^?> 0 ^ftmOT{g>«9 
0 aM9 0 b Mfi.^tietV 
M (DtE MAXfjSM ^Iflg £ ft 

5o 



As for this display section 9, as shown in FIG. 8, 
the screen part 90 of the width direction of a 
display section 9 formed by the liquid crystal 
display etc. almost overall is formed, two image 
region, the left-hand side image region 90a and 
the right-hand side image region 90b, halves 
the screen part 90 from that center section, and 
this screen part 90 is provided. 
The conversion image data into which the 
omnidirectional image data photographed with 
the omnidirectional camera 4 respectively 
arranged left-hand side and on the right-hand 
side of vehicles was converted by the panorama 
image, the perspection image, etc. is displayed 
on each image region 90a and 90b. 



[0 0 8 2] 

9 OMSil^ftSilHtwB? 

± r £ tz ft&tt ft iz&m-t z> 



[0082] 

Moreover, under the screen part 90, the key 
switch which is the display range specification 
part 11 is provided, by operating this key switch, 
it is arranged so that the enlarged display of the 
required parts of designating as required the 
desired region of the image by which it is 
indicated by a screen as the screen part 90, 
transfering the image data displayed on a 
display section 9 to the upper and lower sides 
or a right and left direction, and a display 
section 9 can be carried out. 



[0 0 8 3] [0083] 

jilsj&fN&ftinB 1 2 fi, MWi<D The operation detection part 12 detects 

s^y K/K Jj^^Tjk^^co^W] fluctuation of the handle of vehicles, a turn 

£^£QLT, <W^tftf^^|BlSr signal, etc., it has in order to detect the 
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&&ir2>tz#)\z.$IZ- ( Dtiy operation direction of vehicles, for example, it 

&\ my 3 — ?\ ^^iryf-^ comprises an encoder, the magnetic sensor, 

^XoXmf&ZtiZo etc. 

[0 0 8 4] [0084] 

il^ti \U£.J&%\!> 1 3fi N ilfe^ The operation information generation part 13 

fl^fripfll 2l:J;oT^^fe forms operation information, such as the run 

tctik&ffigkl^Jfc CT> $i^cD^ direction of vehicles, according to the detection 

fj#[S]^<D®feti$g££j&1- result detected by the operation detection part 

5 0 :©WiMi3it 12. 

il^tf ^£r£j$-^5fc#)<7)jl$S This operation information generation part 13 

tf ^^i^^rffiteLT has the operation information storage part 

^j^^tbfcil^tf which stores the formed operation information 

$S : Srf2 , ISi"5il$Ett^lSti§P?r while storing the operation information 

^LTV^So generator for forming operation information. 

[0 0 8 5] [0085] 

iilSff $R£/#pfl 1 3 ri s il$Kj&fE If the operation information generation part 13 

$|£fl|ft 1 2 (D%k%}ffi$k\zgs^5\/^ forms operation information based on the 

iiiSti ^B^r^fiK^S £ > ^ detection result of the operation detection part 

9 £rfc"tf$-f S^^^J^SJ 1 12, the display control part 10 which controls a 

Ofi, r cD^$tL^iHgtS$R display section 9 will display the image data 

{c3S^V-C\ ^^(DlEiMJkXf^ which projects the image data which projects 

(D^M&tyk Lffii^H^x — ^ x the left-hand side of vehicles, and its bottom or 

-^tcliMWi^iMRV^^fDTiM the right-hand side of vehicles, and its bottom 

Lft^iSfJI-r — $ ^r^^pft on the screen of a display section 9 based on 

9 ©Hffil-^TtS cfc 9 M&o this formed operation information. 

[0 0 8 6] [0086] 

r ti\z J: «9 , ilfe^ Since the desired visual-field region is displayed 

[L/^y M/£fcfi^ft^^§£ on a display section 9 by this, without 

j^fELfci: t $-W\P>¥(Dffi performing operation of commanding which 

W^^^Mi^f — $ t LTS&L visual-field region of vehicles it projects as 

j^fE£;ff 9 image data when an driver operates a handle or 

Itft<, /5f ll^^ifHiMi^^ a turn signal during operation, it can aim at an 
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7]>£P9 ic&Tjs&ti&tcib^ X *9 improvement of the safety of one layer more. 

-m <d%±&<d [S] ± £ m h ^ t 

&X$Z> 0 

[0 0 8 7] [0087] 

r. It\ Z(D£ o {z^E-f&Ztitz When displaying image data on the screen of a 

}SfefR$fH^£^VTM{^x~^ display section 9 based on the operation 

%0;7fU9 <Djl®M^^i~ ; 5$n information formed in this way, it enlarges the 

Kite, ^7^9 <D— MWi<D^ki$ image which projects the left-hand side of 

[z, ^SWfel&^roTII^ vehicles, and its bottom to the one whole screen 

Ltti1~iltffe£ri£;k: LX^^^t of a display section 9, and it is sufficient to make 

•5 X o \z. L X t> J: 1/ \ it display on it here. 

[0 0 8 8] [0088] 

&^&Mi$ifeffXW$z For example, when vehicles are being operated 

Ltl/^i^, fc(Djj[*\1rm7jk%$ by high speed operation and a right turn signal 

^%\^tzh^K, ®SffT$£ is operated, the operation information 

J#£P1 3^jl$5^^§(5^^ generation part 13 forms the operation 

^Ip^t-l^VT, ^i^^^^ information vehicles run rightward based on the 

ft(-^fTl~3jI$5ti$&££j& detection result of an operation detection part, 

U -(DlNSlf ^Bf-S^VT, based on this operation information, the visual 

^tt:§P 9 (D±.fc\c^M(D^'$iJ5 information of the method part of the right rear 

p|5^^Hf:tf bi±S of vehicles projects on the whole display section 

i9m o & 9. 

tty^^lnlit^tl^^f^Lyc^^ Moreover, when a left-hand side turn signal is 

dfi, fet^Wll^ff operated, it makes it the visual information of 

^9\^LtH^ti^>X the left rear project on a display section 9 

ry ^ ^TizAtlti t similarly. 

fy]^Jft®\(DWijjTMfc When an driver puts into a back gear, the back 

^tf£P9 (c^LttJ^tL'Sct o \z. bottom by the side of a front passenger seat 

i"5 0 projects on a display section 9. 

[0 0 8 9] [0089] 

Sfc, ittf, *E#a**W*r Moreover 

^HirSS^h Sfcfi, ¥ For example, when an driver brings near 

j^£<lJ${cA;fr£^o ^> ills vehicles by a roadside, or when putting vehicles 
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o****fc»4i£**o»JI!:ttf 



into a car barn, the operation information 
generation part 13 forms the operation 
information about the operation direction of 
vehicles based on the detection result of the 
operation detection part 12, based on this 
operation information, the visual information of 
the method of the right rear of vehicles or the 
left rear projects on the whole display section 9. 



[0 0 9 0] [0090] 

#33, wC0^^(^(4 N <:jSi£:iSi In addition, since vehicles are not operated at 

i$ST*^^LTt^6<75Tr(i^l^ high speed, it is sufficient to make an driver 

05 "C\ il$5#ri** BlSK ^^$£ designate the display range by the display 

ffl^AiipG 1 1 tdi o X^tf^bM range specification part 11 directly in this case. 



[0 0 9 1 ] 

«#tft*n»i 4«4, m»ni(o 



[0091] 

The moving-body detection part 14 stores the 
moving-body detection program for detecting a 
moving body. 

This moving-body detection part 14 detects the 
dislocation of the image data which it produces 
by movement of a moving body by carrying out 
the pattern matching of the omnidirectional 
image data in which the updating memory was 
carried out by control of the control part 1 just 
before or after the image data storage part 8 per 
frame, it detects the moving body which 
approaches vehicles by this detection result. 



[ 0 0 9 2] [0092] 

Z.(D&W}{$(DW&%$fe$tt~f &W) It demonstrates action which detects approach 

f^doi^T, £ £>Mf¥#fflf£tftWl of this moving body in greater detail. 

1r2)o Wf^r— ^ISt8pP8 If omnidirectional image data is stored just 

^^ilH&x — 9 ^ x before or after the image data storage part 8 per 
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frame, the moving-body detection part 14 will 
calculate an inter-frame difference binarization 
image about the omnidirectional image data, 
based on this calculation result, it detects the 
existence of a moving body. 
A detection of a presence of a moving body will 
perform pattern registration about the moving 
body, corresponding to change of the pattern 
accompanying movement of a moving body at 
the same time it is as inter-frame as sequential 
and the registered pattern and detects 
movement of a moving body by performing a 
pattern matching after that, renewal of the 
registration pattern of sequential is carried out. 



[0 0 9 3] 

®mm%mfen 1 

&&Mfe%> 1 5 Xit 

-tzmmtx. 



[0093] 

5 (i, &W} The moving-body speed measurement part 15 
•A£rf[its"t" has the interface which receives the 
v$L&$:'M'Xl composition for measuring the speed of a 
^L(i> moving body, for example, the speed data of a 
Sift speedometer beforehand provided in vehicles, 

/'^-7i while storing a moving-body speed 
* 0)&W)t$ measurement program. 
, 1 In this moving-body speed measurement part 

$L%\ (DM.&t 2 15, it measures the speed of a moving body 
&W)tfc(Dx$i%Z with reference to the speed data of a 
speedometer by control of the control part 1 . 



[0 0 9 4] 

mnmnn i e fi, 

&mmk*ni® i 4 am &u±.<d 
m & x m m { c: m a -r s ® m & 



[0094] 

The alarm-output part 16 comprises a 
loudspeaker, an audio-signal converting circuit, 
an alarm information storage part, etc., for 
example, when the moving-body detection part 
14 detects the moving body (for example, other 
automobile which approaches from back) which 
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<£>SHb$) LfcSI"n(^ approaches vehicles the speed more than 

M^&tf#$Mt$RS:ttl2f1"3 prescribed, it is comprised so that a warning 
«£ b K:1#J$$tV"CV' v &o sound and alarm information may be outputted. 



[0 0 9 5] 

&m&, iiftIslteS«6lsll&^tc 
jiff M 4 O^LT, M-ffiffi 



[0095] 

The communication part 17 comprises the 
antenna which transmits a radio signal, a 
modem (signal modulator demodulator), a radio 
signal converting circuit, the 
communication-circuit connection circuit, etc., 
for example. 

As for this communication part 17, the 
moving-body detection part 14 operates, also 
while vehicles have stopped, when the moving 
body (for example, suspicious person) which 
near-missed is detected between 
predetermined time near the vehicles in stop, it 
has the composition which it transmits to a 
vehicles owner's terminal unit 30 through a 
communication line 40 by control of the control 
part 1 including the image data of the moving 
body detected to alarm information. 



[0 0 9 6] 

fi2 0 Wfjflsfcio^-C* IH 9 {d 



[0096] 

Next, it demonstrates, seeing the flowchart 
shown in FIG. 9 about action of the vehicle 
perimeter display device 20 of this invention. 
In addition, in explanation of the following 
actions, the vehicle perimeter display device 20 
of this invention demonstrates the case where it 
integrates in the side-mirror of vehicles both 
sides. 



[0 0 9 7] [0097] 

* 1", Hl9C07.Ty7 p Sl (c^ First, as shown in step S1 of FIG. 9, it switches 
«fc 5(-> MM (m*5i2:"f) on a power source (not shown), it starts the 
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c^i*® vehicle perimeter display device 20. 



[0 0 9 8] [0098] 

xf y y S 2 (cj; D x & Next, it photographs the image projected on the 

j5<D&1k3j{iLjJ ^74 £>flHH£fl optical systems 4a, such as each convex type 

4 blciot, ^diMfe]!^ 5 rotary-body mirror, by the image pick-up part 4b 

7~-^<D%¥?k 4 a K&B&ti of each right and left omnidirectional camera 4 

fcBfcfgi Sr^^fiiS^T"'— ^ t t as omnidirectional image data by step S2. 

[0 0 9 9] [0099] 

xfyys SHJ;^ # Next, it carries out the renewal memory of the 

i£.~35{iL't> / y 4 «£ 19 Jif^^ti omnidirectional image data photographed with 

tckJditLM^T^— $ ZWiifrf— each omnidirectional camera 4 of sequential per 

^IBtitpG 8 7 J*W-i±LX*M frame by step S3 at the image data storage part 

HkW.ffimW.-fZo 8. 



[0 10 0] 

- * $ tz amnmtT'- 



[0100] 

Next, it converts into conversion image data, 
such as panorama image data which projects 
the both sides of vehicles, and the bottom of 
those by step S4 based on the conversion 
information stored in the conversion information 
storage part 7 by the image data converter 6 in 
the omnidirectional image data photographed 
with the omnidirectional camera 4, or the 
perspection image data. 



[0101] 



[0101] 

Next, it judges whether vehicles are moving by 
the operation detection part 12 by step S5. 
When it is judged that vehicles are moving, it 
progresses to following step S6, and when it is 
judged that vehicles are not moving, it 
progresses to step S21 shown in FIG. 10. 
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[0102] [0102] 

$.-f , ^Pf^^^T't'T'fo-S^-n' First, it demonstrates the case where vehicles 

(coi^-tlftf^j-f -So are moving. 



[0 10 3] 

£tettr$ft±$lSS 1 3 

So 



[0103] 

If it is judged at step 5 that vehicles are moving, 
the operation information generation part 13 will 
form operation information, such as course 
alteration, in step S6 based on the detection 
result of having detected fluctuation of the 
handle by the operation detection part 12, a turn 
signal, etc. 



[0 10 4] [0104] 

7s"f y^S 7 M<fc 9 , W Next, it judges whether vehicles are 

i|£if 1 3ifi±tfLL1tm going-straight runs by step S7 from the 

^if^^^b^i^^ii!iS^fTT*fc operation information which the operation 

5^^^WSrt?)o $[S]^Jl information generation part 13 formed. 

iijfetT"Cfctttt\ ^fy^Sl If vehicles are going-straight runs, it will 

Otcii^ SjSl^jSii^tTT*^ progress to step S10, and if vehicles are not 

tUi\ ^fs/^S 8 Mi! fr 0 going-straight runs, it will progress to step S8. 



[0 10 5] [0105] 

W^iEifi^TT&i^'n * * When vehicles are not going-straight runs, a 

t 1 y^S 8 (CT, S^^J^pBI display control part 10 decides whether to 

0 It, Steffi 1 3 display image data on a display section 9 based 

fiJcLfciHteffif ^xKig^VT, $ on which omnidirectional image data among 

ffiWjSHRiJ^l&ti" btitz^ti^fti each omnidirectional image data photographed 

<D±jjitLJj t y 4 J: o TfiHfe with each omnidirectional camera 4 provided in 

&titc&£ft{iLM$L'r*-?<D 0 the both sides of vehicles in step S8 based on 

V^-f ti<D£:j5$.W1£L7 £ — 9 the operation information which the operation 

icS^V^TM^x 4 —^ ^c^km% information generation part 13 formed. 
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[0 10 6] [0106] 

^(d > yZ?S 9\ZX^ Next, it enlarges and displays conversion 

rfrHii|]p|5 1 0 [zX oT^^^ti/c images, such as panorama image data of the 

M<Ds<S y -^IHfex— ^ , ii^JL side decided by the display control part 10, and 

M{J£:r^^^Wg£|&H^£i§7F the perspection image data, on the one whole 

9 CD— W\Ei<Di£i${ztji:$: It screen of a display section 9 in step S9. 



[0 10 7] 

S 8 £»T£&mflW**^fflS 9 

£axfc»S\ ^f^s i o id 

9 (C^t^ $ tl/cWtx- * <D ¥ 

mi££tite^m&\a*s *y-v 

7*S 1 2jCiitf 0 



[0107] 

When vehicles are going-straight runs in step 
S7, vehicles are not the going-straight 
directions in step S7, when a conversion image 
is enlarged and displayed on the one whole 
screen of a display section 9 passing through 
step S8 from step S7, a display control part 10 
is in step S10, it judges whether the desired 
display range was designated by the display 
range specification part 11 which designates of 
which part of the image data displayed on the 
display section 9 it displays image data. 
When the display range is designated, it 
progresses to step S11, and when the display 
range is not designated, it progresses to step 
S12. 



[0 10 8] [0108] 

M^^ffltfffife&titzWin'fe. When the display range is designated, it 

^r^/Sl ltdT, W$lt — converts the image data converter 6 into 

^l2£lptf6Ji, $afe£tltc&7F conversion images to which it enlarged the 

$50^^^: Ltz'<S y^M^rf designated display range, such as panorama 

— ? , MW&ii&y*— $*^<dW$: image data and the perspection image data, in 

§£#&L, % <D$£&Wi$L : tt step S11, it displays the conversion image on 
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the screen of a display section 9. 



[0 10 9] [0109] 

^ry/S 1 2d"C\ il Next, it displays other information, such as 

i&i&llSr^tf^Sftlff Wl^<D^l multiple-purpose information which contains a 

cotSffi^r^^pP 9 WpJS^lS^: road map in step S12, on the screen of a 

-fSo display section 9. 



[0 1 10] 



[0110] 

Next, it detects whether there is any moving 
body which approaches vehicles the speed 
more than prescribed by the moving-body 
detection part 14 in step S13. 
When the moving body which approaches is 
detected, it progresses to step S14, and when a 
moving body is not detected, it returns to step 
S2. 



[0 111] 

-So 



[0111] 

In this step S13, it detects by the image data 
detected with the pattern matching of 
omnidirectional image data which got mixed up 
per frame in the image data storage part 8 by 
the moving-body detection part 15, and by 
which the updating memory was carried out, 
furthermore, based on this detection result, the 
moving-body speed measurement part 15 
measures the speed of the detected moving 
body with reference to the vehicles 
speedometer provided in vehicles. 



[0 112] [0112] 

Hk\Z y ^7 L ^7 p S14{wT, # Next, a warning sound and alarm information 

SRtttfjgpi 6HioTtra are outputted by the alarm-output part 16 in 

tfS^iW^tti^ft, XTy step S14, it returns to step S2. 
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[0113] [0113] 

Hklz^ ±127.7 y 7° S 5}«1T N Next, above-mentioned step S5 demonstrates 

^T'&v^-pi^&tt action of the vehicle perimeter display device of 

S^^^W^ffiJ^ISi^^fLd this invention when vehicles are not moving 

WjffMcoV'T, Ull 0\C7jki-y with reference to the flowchart shown in FIG. 10. 

5 0 



[0 114] 

£/c, |g|9^i-^o— 7-* — 
b\Z.tott&X7--y7S 5 KIT, 

Sir, xfy/S 2 1 (CT, $ 
fflift 1 wSiJ^^o 7*7 -Mc!££ 

7 7 7°S 2 2£ji^ E19^ 



[0114] 

Moreover, if it is judged in step S5 in the slow 
chart shown in FIG. 9 that vehicles are not 
moving, it will judge whether in step S21, the 
vehicle perimeter display device 20 is set as the 
control program of the control part 1 so that the 
shutdown of vehicles may also continue action. 
If it is set up so that action may be continued 
during operation of vehicles, it will progress to 
step S22 and will return to step S2 of the 
flowchart shown in FIG. 9. 



[0 115] 

XTyZfS 2 2 (CT, * 



9 t/^t^r i/7°S 2 



[0115] 

Next, it judges whether it detected the moving 
body which approached near vehicles beyond 
over predetermined time in step S22 by the 
moving-body detection part 14. 
When a moving body is detected, it progresses 
to step S23, and when not detecting a moving 
body, it returns to step S2 shown in FIG. 9. 
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[0 1 16] [0116] 

T-f y/S 2 3 lc ioT, Next, in order to notify vehicles possession etc. 

$ffiWifpZ2ic^li!]##^i£ Lfc about the moving body having approached near 

Z. t &'&Wf>ft : &mz.%\b-& : btz vehicles by step S23, it outputs a warning 

fete, i^iU^gpi 6fiJ;oT sound by the alarm-output part 16. 

[0117] [0117] 

7,7 y 7°S 2 4 t£"C\ il Next, it transmits the alarm information 

{%% 1 7 (c iot, ■f'&iifiSc containing the image data of the moving body 

8fc$*ifcfl«$£>affl5|5gll3 0 detected to the terminal unit 30 of the exterior 

Ki> %k%n Ltz&W)fc<DWi&T— by which communication connection was made 

*£^tr£$RJf 3 beforehand to a terminal unit 30 by the 

0 l£i£f§ "t"<5 0 communication part 17 in step S24. 



[0118] [0118] 

^{c, 7,ry7*S 2 5 tt, %k Next, it stores the image data of the moving 

£fl Lfc^®j#:<D®lg>x — ^ SriS body detected in step S25 in the image data 

^r — ^fSlt^ 9 MlEtlU H storage part 9, it returns to step S2 shown in 

9(^-r^x-y^S 2Kmt>o FIG. 9. 



[0 119] 

lite, WM^^imteK 

LXm^U 9 t-3t^ £ 
^ <Di&fr^ 9 $ titzMiA 



[0119] 

By performing action which passed through 
each step demonstrated above, the driver who 
rides vehicles can acquire the omnidirectional 
image data which projects the both-sides back 
of vehicles with the omnidirectional camera 4 as 
picture information. 

It converts this omnidirectional image data into 
conversion images, such as a desired 
panorama image of the driver of vehicles, and 
the perspection image, and it is displayed on a 
display section 9 by the image data converter 6, 
by recognizing the image data displayed on this 
display section 9, the driver of vehicles can 
grasp the situation around vehicles exactly. 
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[0 12 0] 

K J; o r $ *LfcKte&ttK 



[0120] 

Therefore, the driver of vehicles can improve 
the safety of a vehicles run further by 
recognizing the image shown with the image 
perimeter display device 20 of this invention. 
Furthermore, a visual information wide range 
about the perimeter of vehicles, and since the 
visual information of the lower part of vehicles is 
particularly acquirable, the vehicle perimeter 
display device 20 of this invention is, by 
recognizing the display section 9 of this vehicle 
perimeter display device 20, when bringing near 
vehicles by the end of a road, it can prevent a 
wheel fall-off, moreover, when putting vehicles 
into a car barn, it can prevent letting the wall of 
a car barn etc. contact vehicles, and can 
prevent deviation from a track at the time of a 
vehicles run. 



[0121] 

3 6 0° ©WStt&iMW-S 
9, hX*J.o»AI4tcffi 



[0121] 

Moreover, the vehicle perimeter display device 
20 of this invention can photograph the 
visual-field region of maximum perimeter 360 
degrees about the perimeter of vehicles with the 
omnidirectional camera 4. 
Therefore, it is not necessary to provide the 
rotation mechanism for enabling it to rotate to 
the photographing means which photographs 
the perimeter of vehicles, the control system 
which accompanies the rotation mechanism, 
and the composition for photographing the 
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perimeter of vehicles becomes easily, it is 
low-cost and excels in durability. 



[0122] 



[0122] 



a, in^x - * mmi® iao-c, 



[ADVANTAGE OF THE INVENTION] 

The vehicle perimeter display device of this 
invention can acquire the omnidirectional image 
data which projects the both-sides back of 
vehicles with the omnidirectional camera 
provided in the side part of vehicles as picture 
information. 

It converts this omnidirectional image data into 
conversion images, such as a desired 
panorama image of the driver of vehicles, and 
the perspection image, and it is displayed on a 
display section by the image data converter, the 
driver who operates vehicles can grasp the 
situation around vehicles exactly by recognizing 
the image data displayed on this display 
section. 

Therefore, the driver of vehicles can improve 
the safety of a vehicles run further by 
recognizing the image shown with the image 
perimeter display device of this invention. 



[BRIEF DESCRIPTION OF THE DRAWINGS] 



m 1 1 [fig 1] 

%imW<DMW\mm%:^$iW<nfflL It is the block diagram showing the outline 

^M^i^^iT'f d v f MXfo composition of the vehicle perimeter display 

<5 0 device of this invention. 



[H2] [FIG 2] 

5 y— 3£\lklz.%L$£VJl\z.i&Z)'£.3i An example in the state where it integrated the 
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{\LtJ / 7 &B.fyj&Astz$>M&>— omnidirectional camera based on this invention 

#12r^ LT& 9, SI2 (a) It is shown in the mirror apparatus, FIG.2(a) is the 

&\ft)(DfcM\zl§Li9 tftf 5 top view showing the state where it integrated 

^^-^ffifc^^fi^ ^ 7 £r&fi^ the omnidirectional camera to the mirror 

iZ^fct^fi^l^ffiEk IH 2 apparatus attached to the right-hand side of 

(b) ft 0 2 (a) (Dftjjfr vehicles, FIG.2(b) is the side view seen from the 

b&tzMmm, El 2 (c) It right side of FIG2(a), FIG.2(c) shows the side 

El 2 (a) (D'&jjfrh&tctiim view seen from the back of FIG2(a). 

[[213] [FIG. 3] 

£jj{iL% / 7 & 5 7 It is the perspective diagram showing the state 

£f£l5[<L$:£f L/c^ffi£^i~£l4& where it maintained the omnidirectional camera 

<5 0 to the retainer of a mirror apparatus. 

[El 4] [FIG. 4] 

^jjiiLfi / 7 £r 5 7— ^Sl^^ It is the perspective diagram showing the other 

WlftlzifcWLtzjfacDffil&Tjk^ffl example which maintained the omnidirectional 

l&M^fo&o camera to the retainer of a mirror apparatus. 

[El 5] [FIGS] 

^^Kl^S^^ffi* > 7 £\ When the omnidirectional camera based on this 

MM<OMM^\^^L 9 f\Mt kti5 invention is attached to the side-mirror attached 

7 — 9 ttttfcSI to the both sides of vehicles, the visual-field 

£\ region which the driver who rides vehicles can 

5: <b^T^5?liffI^c^*L get is shown, FIG.5(a) is a top view, FIG5(b) 

X & *) , El 5 ( a ) ft ^®E! > each shows the front elevation. 
EI5 (b) it ESEI^W 

[El 6] [FIG 6] 

±Jj{tL^f^ 7t^£ffi£ftM¥ It is the outline block diagram showing the 

L composition of a hyperboloid mirror as a convex 

T^iS; 7 — (D^^^jjk^Wi type rotary-body mirror which is the optical 

B§f$j$EI~Cfc£o system used for an omnidirectional camera. 
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[0 7] [FIG. 7] 

HI 7 ( a ) fi, ik~)5\lLt) The image data of the ring shape in the middle 

ioT^^^tifc^^'flilf^T"' of the omnidirectional image data and FIG.7(b) 

— 9s HI 7 (b) its ±MtLM by which FIG.7(a) was photographed with the 

%Jf— 9 7^H^(^^1 !? omnidirectional camera cutting open 

PI < j^'t^Jott 5 V y?ty:<DM omnidirectional image data in a panorama 

^f— 9s HI 7 (c) f4> /V image, and FIG.7(c) show panorama image 

7-7ltf-^^LT^5, data. 



[18] 

^r^1-jE®E|-Cfo5o 



[FIG 8] 

It is the front elevation showing an example 
which displays image data on the display 
section installed ahead of a driver's seat. 



[H! 9 ] 

- YX3bZ> 0 



[FIG 9] 

l<DW) It is a flowchart explaining action of the vehicle 
-Y perimeter display device of this invention. 



[mi 0] 

Plt^7P-ft- hXh 

•So 



[FIG 10] 

It is a flowchart explaining action of the vehicle 
perimeter display device of this invention when 
vehicles are not moving. 



[011] 

Zffi x. 5 w t \z J: o X Mm (DM 

Kfttte-ox nm-r z^ttfx 



[FIG 11] 

It is the top view each showing the blind-spot 
region which constitutes blind spot of the 
visual-field region which the driver who rides on 
the driver's seat of vehicles can recognize, and 
vehicles, and cannot be recognized by having a 
side-mirror and a room mirror. 



1 2] [FIG 12] 

¥Pl Willcjffit^SIIiE^i'/^il It is a side view from the right-hand side side of 
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l&i~-5 ^1 h^MW^ii: the vehicles in which the visual-field region 

T^lrMWi^jiMMjjfr h <7){|iJE which the driver who rides on the driver's seat of 



vehicles can recognize is shown. 



i wsm 

3 /<y77>*!l 



[DESCRIPTION OF SYMBOLS] 

1 Control part 

2 Program memory 

3 Buffer memory 



4 / 7 

4 a ft^m 

4 b ffiftffl 

5 =; y—'^W. 



4 Omnidirectional camera 
4a Optical system 

4b Image pick-up part 

5 Mirror apparatus 



5 a 7iyf- 

5 b mw- 

5 c &tfg|5 

5 d i&mn 



y— 5a Fender mirror (side-mirror) 

5b Housing 

5c Attachment 

5d Retainer 



6 iHfrr-^&gB 

8 u^x-^iait^ 

9 UtfU 



6 Image data converter 

7 Conversion information storage part 

8 Image data storage part 

9 Display section 



l o &7fiWfaU 

i i m^mmfe^ 

1 2 aHEftfft£*R*|S 

1 3 Stetff«^fifeS|5 



1 0 Display control part 

1 1 Display range specification part 

12 Operation detection part 

13 Operation information generation part 



1 4 ®W}&mM 

1 5 &$hfcmmmj£& 

1 6 

i 7 iifgffi 



14 Moving-body detection part 

1 5 Moving-body speed measurement part 

16 Alarm-output part 

17 Communication part 



l 8 



18 Bus 
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[FIG. 1] 



/20 



"V 1 



5>N 
36N 

5o 



5^ 



* Nj yam* 



fit* 



11 N a*sas 



15>J 



V3 



t§8 



Ettg 



E*3 



"-18 



^•13 
V16 



^17 




1 : Control part 

2: Program memory 

3: Buffer memory 

4: Omnidirectional camera 

4a: Optical system 

4b: Image pick-up part 

5: Mirror apparatus 

5a: Fender mirror/side-mirror 

5b: Housing 

5c: Attachment 

5d: Retainer 

6: Image data converter 
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7: Conversion information storage part 

8: Image data storage part 

9: Display part 

10: Display control part 

11: Display range specification part 

12: Operation detection part 

13: Operation information generation part 

14: Moving-body detection part 

15: Moving-body speed measurement part 

16: Alarm-output part 

17: Communication part 



[I212] [FIG 2] 




5a 5d 
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[0 3] [FIG. 3] 
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[@5] [FIG 5] 




Ground 
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[FIG. 6] 




P— P 1 

flfiifi$|: Asymptote 
tilt: Eyesight 

Lens main point to focus position of hyperbolic curve mirror 
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[FIG. 7] 






P0CY) ' 







POfO.0) 



[Hil] 



[Fia 11] 



A 




A: View angle by visual observation 
B: View angle by side mirror 
C: View angle by room mirror 
D, F: Blind area 

E: Blind area behind side mirror 
Driver 
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[FIG. 8] 
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[FIG. 10] 



S21 



X 



S22 



S23^ 



> 



S24 



S25 



I - 



S21: Is the vehicle perimeter display device designed to operate after operation 
stop of vehicle ? 

S22: Has it detected movable body approached near the vehicle for more than 
specified time ? 

S23: Output alarm sound from alarm output part 16 

S24: Transmit alarm information including image data of detected movable body 
to terminal 30 

S25: Store image data of detected movable body to image data storing part 8 
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[Hi 2] [FIG 12] 




G: View angle by visual observation 
H: View angle by side mirror 
W.fa: Blind area 
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[0 9] [FIG 9] 

SI =1 



S2 



S3 ~ ^ 



S4 



S5 



S6 *v 



lY (S21 




S7 



S8 



IN 



53 "Nj ftss*ifc« jrosi/ O^ffla-T-^sfcit 



S10 



IE 



S12 ^ 
S13 



S14 ^ " 



sampan Gfrttmttzitwnttm mrz 
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S1: Start vehicle perimeter display device 

S2: Photograph image projected to each optical system 4a as omnidirectional 
image data 

S3: Update and store omnidirectional image data sequentially in image data 
storing part 8 by frame unit 

S4: Convert omnidirectional image data to panorama image data or perspective 
image to project both sides of vehicle and the bottom side based on conversion 
information 
S5: Driving ? 

S6: Create driving information 
S7: Driving in straight line ? 

S8: Decide to display image data by which side omnidirectional camera 4 of 
vehicle photographed 

S9: Display enlarged panorama image data or perspective image data of 
decided side on screen of display part 9 
S10: Is the display area specified ? 

S11: Display enlarged panorama image data or perspective data of specified 
display area on screen of display part 9 

S12: Display multi-purpose information including road map on screen of display 
part 9 

S13: Has it detected any movable body which approached at more than 
specified speed ? 

S14: Output alarm sound or alarm information fro alarm output part 16 
End 
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Thomson Scientific Ltd shall not in any circumstances be liable or responsible for 
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